-- Logs begin at Mon 2022-07-04 07:19:07 UTC, end at Mon 2022-07-04 08:20:54 UTC. -- Jul 04 07:54:47.426950 dv-cinder-797608-42-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 07:54:47.441066 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 07:54:47.444117 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 07:54:47 2022] *** Jul 04 07:54:47.444117 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 07:54:47.444117 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 07:54:47.444117 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: nodename: dv-cinder-797608-42-iscsi Jul 04 07:54:47.444117 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: machine: x86_64 Jul 04 07:54:47.444117 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: clock source: unix Jul 04 07:54:47.444117 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: pcre jit disabled Jul 04 07:54:47.444117 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: detected number of CPU cores: 4 Jul 04 07:54:47.444718 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: current working directory: / Jul 04 07:54:47.444718 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: detected binary path: /usr/bin/uwsgi-core Jul 04 07:54:47.444718 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: your processes number limit is 47680 Jul 04 07:54:47.444718 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: your memory page size is 4096 bytes Jul 04 07:54:47.444718 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: detected max file descriptor number: 2048 Jul 04 07:54:47.444718 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: lock engine: pthread robust mutexes Jul 04 07:54:47.444718 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: thunder lock: enabled Jul 04 07:54:47.444718 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 07:54:47.445274 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 07:54:47.500816 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: Python main interpreter initialized at 0x56545b43f9c0 Jul 04 07:54:47.500816 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: python threads support enabled Jul 04 07:54:47.500816 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: your server socket listen backlog is limited to 100 connections Jul 04 07:54:47.500816 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: your mercy for graceful operations on workers is 90 seconds Jul 04 07:54:47.501234 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 07:54:47.501234 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: *** Operational MODE: preforking *** Jul 04 07:54:47.501558 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: *** uWSGI is running in multiple interpreter mode *** Jul 04 07:54:47.501558 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: spawned uWSGI master process (pid: 103153) Jul 04 07:54:47.501856 dv-cinder-797608-42-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 07:54:47.502597 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: spawned uWSGI worker 1 (pid: 103154, cores: 1) Jul 04 07:54:47.502820 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: spawned uWSGI worker 2 (pid: 103155, cores: 1) Jul 04 07:54:47.503081 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 07:54:48.161178 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 07:54:48.161923 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 07:54:49.290037 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 07:54:49.290037 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: from cryptography.utils import int_from_bytes Jul 04 07:54:49.290663 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 07:54:49.290663 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: from cryptography.utils import int_from_bytes Jul 04 07:54:49.294335 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 07:54:49.294335 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: from cryptography.utils import int_from_bytes Jul 04 07:54:49.294829 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 07:54:49.294829 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: from cryptography.utils import int_from_bytes Jul 04 07:54:51.837036 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 07:54:51.837734 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 07:54:51.837889 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 07:54:51.838260 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 07:54:51.838510 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 07:54:51.838889 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.839208 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.839518 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.839826 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.840149 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.840454 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.840763 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.841073 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.841389 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.841652 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.841956 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.842271 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-42-iscsi {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.842585 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.842889 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.843188 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.843498 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.843594 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 07:54:51.843964 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.844046 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 07:54:51.844126 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.844369 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 07:54:51.844484 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.844734 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 07:54:51.844860 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.845286 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 07:54:51.845421 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.845530 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.845685 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.845807 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.845923 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.846030 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.846337 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.846471 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.846631 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.846725 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.847032 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.847356 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.847661 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.847798 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.847997 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.848115 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.848307 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.848452 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.848637 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.848735 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-42-iscsi {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.848903 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.849040 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.849223 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.849317 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.849564 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-42-iscsi {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.849736 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.849913 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.850067 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.850226 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.850344 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.850661 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.850847 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.850997 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.851134 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.851237 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.851322 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.851484 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.851592 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.851784 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.851937 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.852134 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.852266 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.852449 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.852595 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.852769 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.852940 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.853042 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.853158 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.853345 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.853500 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.853816 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.853909 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.854138 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.854237 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.854459 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.854558 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.854768 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.854867 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.855069 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.855165 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.855373 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.855473 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.855694 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.855785 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-42-iscsi {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.856009 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.856107 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.856329 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.856422 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.856585 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.856683 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.856821 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.857090 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.857186 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.857402 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.857495 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.857732 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.857823 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.858371 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.858483 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.858622 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.858715 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.858841 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.858929 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.859040 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.859134 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.859269 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.859366 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.859501 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.859587 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.859784 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.859896 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.860098 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.860196 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.860408 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.860496 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.860769 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.860904 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.861101 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.861282 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.861418 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.861522 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.861722 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.861829 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.861979 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.862389 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.862389 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.862764 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.862936 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.863079 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.863298 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.863400 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.863631 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.863729 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.863961 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.864053 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.864220 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.864319 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.864476 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.864632 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.864802 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.864967 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.865142 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.865285 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.865434 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.865653 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.865772 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.865956 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.866092 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.866203 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.866401 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.866569 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.866709 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.866874 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.867030 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.867196 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.867344 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.867493 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.867613 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.867789 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.867914 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.868090 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.868233 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.868382 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.868559 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.868689 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.868863 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.868987 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.869186 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.869281 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.869578 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.869732 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.869907 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.870052 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.870153 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.870236 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.870482 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.870579 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.870780 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.870931 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.871080 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.871201 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.871401 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.871501 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.871716 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.871804 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.872014 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.872111 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.872310 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.872411 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.872607 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.872713 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.872910 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.872997 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.873222 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.873315 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.873523 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.873640 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.873803 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.873891 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.874106 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.874195 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.874413 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.874507 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.874719 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.874872 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.875023 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.875136 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.875327 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.875427 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.875633 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.875829 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.875943 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.876148 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.876261 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.876455 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.876596 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.876742 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.876890 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.877055 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.877199 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.877357 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.877453 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.877695 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.877831 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.878023 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.878268 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.878356 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.878612 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.878783 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.878932 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.879080 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.879253 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.879351 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.879578 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.879706 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.879870 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.879968 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.880177 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.880264 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.880487 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.880577 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.881149 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.881271 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.881462 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.881712 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.881882 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.882001 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.882085 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.882341 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.882437 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.882673 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.882780 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.882987 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.883085 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.883332 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.883464 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.883666 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.883875 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.884052 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.884208 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.884376 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.884526 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.884699 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.884847 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.884993 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.885140 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.885294 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.885449 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.885682 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.885825 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.885951 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.886096 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.886224 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.886345 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.886486 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.886610 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.886748 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.886879 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.887006 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.887147 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.887299 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.887431 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.887676 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.888030 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.888167 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.888323 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.888456 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.888597 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.888755 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.888887 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.889017 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.889158 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.889291 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.889451 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.889598 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.889747 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.889831 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.889970 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.890084 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.890185 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 07:54:51.890388 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.890480 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.890709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.890993 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.891157 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.891327 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.891418 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.891532 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.891645 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.891735 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.891902 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.892002 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.892217 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.892316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.892553 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.892762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.892972 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.893185 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.893573 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.893826 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.893966 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.894106 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.894205 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.894398 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.894712 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.894891 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.895022 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.895128 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.895309 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.895547 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.895678 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.895767 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.895898 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.896108 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.896271 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.896507 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.896726 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.896862 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.897132 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.897376 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.897376 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.897691 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.897781 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.897863 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.898037 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.898171 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.898335 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.898469 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.898612 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.898777 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.898911 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.899009 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.899258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.899437 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.899583 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.899743 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.899842 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.899994 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.900164 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.900300 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.900493 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.900646 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.900769 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.900953 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.901086 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.901245 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.901410 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.901600 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.901920 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.902074 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.902222 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.902356 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.902454 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.902546 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.902703 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.902990 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.903125 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.903269 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.903372 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.903586 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.903790 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.903904 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.904114 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.904221 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.904488 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.904622 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.904800 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.904934 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.905113 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.905264 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.905384 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.905483 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.905704 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.905837 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.906038 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.906208 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.906332 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.906455 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.906646 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.906759 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.906950 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.907074 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.907262 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.907361 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.907570 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.907681 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.907876 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.907984 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.908183 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.908287 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.908494 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.908593 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.908799 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.908908 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.909183 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.909296 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.909484 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.909805 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.909917 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.910106 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.910225 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.910405 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.910506 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.910705 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.910830 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.911002 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.911108 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.911299 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.911407 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.911618 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.911727 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.911984 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.912088 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.912180 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.912291 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.912485 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.912596 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.912788 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.912895 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.913084 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.913176 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.913381 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.913487 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.913703 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.913798 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.914042 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.914146 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.914352 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.914613 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.914826 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.915037 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.915269 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.915443 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.915597 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.915744 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.915917 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.916079 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.916214 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.916409 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.916823 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.916969 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.917106 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.917306 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.917512 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.917776 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.917992 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.918130 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.918278 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.918278 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.918538 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.918697 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.918833 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.918973 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.919105 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.919247 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.919380 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.919520 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.919663 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.919803 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.919934 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.920065 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.920197 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.920341 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.920473 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.920605 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.920744 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.920875 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.921014 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.921154 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.921287 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.921430 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.921563 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.921687 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.921788 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.921880 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.921961 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.922042 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.922277 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.922366 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.922519 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.922614 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.922748 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.922838 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.923093 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.923236 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.923432 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.923576 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.923717 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.923816 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.924041 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.924187 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.924296 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.924380 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.924691 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.924825 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.925130 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.925450 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.925593 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.925845 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.925940 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.926164 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.926309 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.926501 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.926698 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.926836 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.926933 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.927099 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.927233 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.927432 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.927565 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.927745 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.927879 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.928054 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.928187 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.928343 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.928439 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.928841 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.928980 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.929093 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.929213 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.929340 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.929431 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.929661 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.929751 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.929883 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.929986 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.930140 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.930293 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.930445 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.930608 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.930730 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.930929 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.931022 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.931219 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.931311 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.931537 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.931642 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.931878 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.931974 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.932179 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.932281 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.932500 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.932607 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.932805 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.932894 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.933121 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.933213 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.933432 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.933597 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.933796 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.933894 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.934062 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.934162 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.934372 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.934469 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.934740 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.934838 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.934967 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.935053 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.935254 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.935357 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.935560 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.935652 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.935891 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.935990 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.936195 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.936283 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.936500 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.936593 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.936813 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.936936 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.937125 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.937215 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.937430 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.937520 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.937764 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.937858 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.938071 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.938195 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.938373 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.938471 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.938689 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.938778 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.938997 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.939097 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.939300 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.939388 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.939610 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.939700 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.939914 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.940002 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.940247 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.940363 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.940803 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.940902 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.941191 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.941500 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.941597 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.941928 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.942081 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.942203 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.942297 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.942431 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.942679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.942772 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.943038 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.943142 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.943393 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.943726 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.943818 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.944035 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.944142 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.944349 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.944620 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.944749 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.944845 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.945016 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.945127 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.945328 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.945425 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.945636 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.945928 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.946022 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.946269 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.946363 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.946599 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.946699 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.946905 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.946993 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.947206 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.947484 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.947582 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.947799 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.947989 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.948130 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.948330 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.948439 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.948682 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.948776 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.949000 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.949178 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.949329 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.949772 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.949882 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.950011 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.950097 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.950264 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.950370 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.950589 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.950686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.950884 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.950974 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.951191 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.951292 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.951489 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.951578 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.951805 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.951898 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.952108 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.952212 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.952411 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.952503 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.952708 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.952837 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.953013 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.953213 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.953373 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.953529 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.953731 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.953909 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.954080 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.954233 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.954388 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.954551 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.954701 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.954850 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.955014 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.955205 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.955376 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.955538 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.955700 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.955962 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.956128 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.956277 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.956277 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.956543 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.956686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.956837 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.957004 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.957151 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.957608 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.957608 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.957934 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.958096 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.958246 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.958391 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.958539 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.958695 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.958845 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.959005 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.959160 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.959308 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.959465 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.959612 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.959774 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.959953 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.960109 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.960261 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.960405 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.960562 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.960710 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.960863 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.961024 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.961182 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.961329 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.961486 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.961671 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.961820 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.961985 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.962135 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.962294 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.962446 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.962603 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.962788 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.962788 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.963086 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.963254 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.963402 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.963563 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.963724 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.963866 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.964012 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.964169 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.964318 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.964466 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.964624 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.964772 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.964918 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.965060 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.965213 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.965422 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.965601 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.965773 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.965920 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.966070 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.966216 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.966216 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.966519 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.966666 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.966807 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.966964 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.966964 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.967266 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.967415 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.967677 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.967832 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.967999 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.968147 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.968308 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.968450 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.968584 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.968584 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.968859 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.969006 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.969172 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.969323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.969469 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.969665 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.969817 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.970047 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.970202 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.970349 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.970479 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.970607 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.970736 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.970988 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.971120 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.971275 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.971404 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.971611 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.971742 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.971882 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.972015 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.972015 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.972273 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.972273 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.972515 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.972658 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.972918 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.973062 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.973228 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.973381 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.973540 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.973713 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.973854 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.973986 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.974178 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.974388 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.974556 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.974705 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.974865 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.975022 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.975172 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.975321 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.975543 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.975692 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.975692 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.975995 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.975995 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.976280 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.976280 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.976556 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.976702 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.976847 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.976983 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.977137 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.977299 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.977451 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.977451 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.977828 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.978003 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.978166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.978306 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.978460 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.978600 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.978755 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.978895 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.979054 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.979136 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.979267 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.979385 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.979578 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.979711 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.979888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.980029 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.980208 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.980337 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.980514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.980660 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.980802 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.980933 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.981113 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.981246 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.981441 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.981587 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.981773 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.981912 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.982093 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.982206 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.982407 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.982555 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.982712 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.982842 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.983020 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.983280 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.983419 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.983622 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.983762 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.983932 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.984125 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.984328 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.984483 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.984646 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.984796 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.984896 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.984992 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.985114 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.985279 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.985423 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.985561 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.985829 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.985996 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.986147 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.986303 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.986446 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.986588 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.986712 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.986854 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.986996 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.987202 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.987412 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.987586 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.987785 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.988091 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.988431 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.988611 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.988757 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.988903 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.989060 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.989212 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.989376 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.989518 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.989694 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.989910 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.990083 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.990229 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.990401 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.990547 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.990686 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.990837 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.990981 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.991128 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.991288 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.991390 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.991500 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.991677 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.991837 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.991991 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.992141 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.992290 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.992433 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.992576 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.992719 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.992883 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.993033 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.993175 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.993322 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.993466 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.993610 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.993827 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.993985 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.994193 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.994396 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.994541 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.994688 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.994850 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.994995 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.995140 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.995293 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.995455 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.995600 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.995765 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.995982 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.996144 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.996287 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.996432 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.996596 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.996752 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.996900 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.997029 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.997156 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.997268 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.997415 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.997546 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.997664 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.997843 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.997998 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.998159 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.998283 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.998467 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.998612 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.998782 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.998911 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.999083 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.999222 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.999389 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.999485 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.999705 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:51.999852 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.000108 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.000250 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.000402 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.000543 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.000683 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.000774 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.001014 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.001136 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.001321 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.001452 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.001720 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.001844 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.001985 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.002157 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.002288 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.002465 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.002587 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.002834 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.002984 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.003424 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.003728 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.003825 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.004048 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.004163 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.004350 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.004488 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.004655 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.004765 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.004961 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.005060 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.005287 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.005413 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.005993 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.006178 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.006319 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.006408 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.006620 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.006768 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.006943 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.007042 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.007275 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.007377 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.007581 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.007687 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.007890 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.007982 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.008198 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.008330 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.008524 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.008632 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.008834 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.008924 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.009156 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.009254 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.009452 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.009577 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.009771 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.009919 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.010072 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.010227 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.010409 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.010646 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.010745 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.010968 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.011058 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.011283 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.011490 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.011613 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.011713 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.011925 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.012047 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.012248 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.012359 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.012571 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.012686 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.012878 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.013027 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.013192 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.013332 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.013510 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.013683 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.013835 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.014013 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.014134 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.014326 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.014466 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.014644 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.014740 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.014950 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.015055 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.015275 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.015374 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.015583 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.015674 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.015878 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.015976 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.016172 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.016301 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.016466 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.016625 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.016784 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.016950 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.017182 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.017275 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.017573 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.017692 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.017925 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.018018 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.018227 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.018624 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.018735 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.018935 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.019206 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.019310 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.019546 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.019697 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.019841 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.019986 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.020154 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.020251 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.020484 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.020618 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.020840 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.021002 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.021094 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.021207 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.021411 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.021553 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.021747 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.021917 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.022052 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.022192 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.022363 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.022527 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.022673 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.022859 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.022981 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.023178 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.023318 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.023526 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.023680 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.023921 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.024064 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.024235 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.024329 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.024545 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.024706 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.024874 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.024971 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.025223 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.025425 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.025521 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.025773 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.025960 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.026091 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.026177 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.026382 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.026508 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.026692 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.026803 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.026998 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.027096 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.027304 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.027403 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.027618 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.027726 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.027920 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.028064 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.028207 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.028366 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.028501 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.028640 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.028829 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.028951 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.029142 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.029305 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.029464 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.029776 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.029893 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.030102 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.030198 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.030411 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.030504 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.030715 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.030822 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.031019 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.031123 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.031325 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.031415 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.031630 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.031720 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.031934 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.032051 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.032248 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.032347 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.032550 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.032660 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.032853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.032964 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.033155 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.033245 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.033466 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.033672 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.033831 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.033932 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.034153 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.034300 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.034481 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.034794 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.035071 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.035183 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.035393 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.035485 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.035711 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.035808 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.036035 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.036137 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.036385 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.036493 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.036699 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.036830 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.037007 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.037107 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.037320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.037463 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.037706 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.038020 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.038337 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.038882 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.039192 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.039473 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.039581 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.039802 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.039895 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.040126 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.040217 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.040447 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.040536 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.040761 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.040851 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.041083 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.041183 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.041381 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.041483 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.041706 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.041799 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.042018 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.042108 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.042326 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.042504 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.042630 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.042735 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.042951 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.043088 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.043251 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.043513 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.043613 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.043847 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.043984 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.044150 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.044306 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.044470 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.044680 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.044779 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.045025 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.045143 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.045338 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.045456 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.045675 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.045768 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.045999 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.046131 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.046308 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.046402 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.046608 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.046731 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.046928 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.047031 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.047241 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.047333 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.047540 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.047645 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.047851 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.047950 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.048154 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.048245 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.048457 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.048554 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.048788 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.048941 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.049060 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.049159 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.049365 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.049459 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.049736 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.049929 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.050047 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.050346 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.050446 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.050668 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.050813 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.050970 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.051147 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.051267 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.051461 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.051592 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.051775 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.051876 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.052088 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.052180 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.052407 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.052527 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.052715 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.052837 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.053016 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.053162 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.053303 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.053420 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.053604 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.053721 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.053927 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.054057 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.054228 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.054341 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.054537 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.054679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.054818 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.054967 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.055127 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.055249 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.055480 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.055578 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.055801 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.055890 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.056101 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.056362 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.056468 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.056678 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.056775 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.057001 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.057132 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.057326 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.057461 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.057655 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.057766 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.057956 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.058064 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.058284 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.058379 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.058600 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.058724 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.058980 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.059151 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.059253 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.059484 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.059575 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.059798 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.059893 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.060105 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.060197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.060428 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.060518 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.060738 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.060834 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.061041 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.061129 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.061343 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.061463 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.061682 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.061844 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.061992 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.062227 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.062324 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.062586 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.062682 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.062891 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.062988 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.063195 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.063311 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.063502 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.063601 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.063803 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.063894 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.064106 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.064255 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.064413 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.064518 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.064716 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.064806 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.065020 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.065110 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.065383 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.065539 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.065718 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.066028 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.066370 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.066490 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.066681 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.066787 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.066992 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.067103 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.067307 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.067416 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.067616 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.067707 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.067921 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.068059 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.068225 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.068322 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.068527 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.068619 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.068834 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.068945 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.069144 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.069243 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.069459 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.069558 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.069796 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.069894 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.070110 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.070259 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.070414 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.070568 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.070721 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.070907 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.071029 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.071223 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.071324 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.071538 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.071648 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.071839 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.071930 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.072157 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.072280 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.072476 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.072579 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.072781 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.072897 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.073095 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.073188 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.073403 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.073500 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.073748 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.073857 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.074084 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.074175 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.074390 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.074509 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.074697 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.074804 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.075007 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.075106 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.075302 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.075392 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.075601 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.075732 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.075904 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.076005 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.076215 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.076305 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.076526 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.076641 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.076817 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.076917 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.077119 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.077416 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.077529 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.077736 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.077858 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.078032 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.078183 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.078331 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.078523 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.078630 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.078859 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.079017 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.079176 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.079294 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.079486 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.079605 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.079779 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.079903 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.080080 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.080197 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.080371 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.080475 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.080668 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.080759 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.081097 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.081207 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.081366 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.081700 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.081883 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.081976 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.082203 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.082346 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.082529 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.082660 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.082841 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.082946 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.083160 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.083271 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.083467 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.083555 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.083779 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.083944 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.084094 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.084345 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.084472 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.084672 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.084824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.084973 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.085083 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.085293 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.085406 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.085611 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.085728 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.085943 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.086062 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.086250 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.086380 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.086580 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.086699 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.086884 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.086983 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.087245 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.087373 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.087502 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.087700 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.087855 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.088013 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.088118 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.088387 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.088484 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.088708 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.088812 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.089031 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.089204 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.089459 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.089607 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.089756 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.089861 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.089949 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.090176 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.090268 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.090498 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.090605 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.090822 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.090927 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.091171 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.091366 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.091461 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.091544 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.091902 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.092042 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.092228 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.092349 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.092555 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.092683 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.092858 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.092949 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.093173 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.093281 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.093482 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.093576 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.093831 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.093923 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.094153 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.094243 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.094460 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.094554 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.094767 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.094856 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.095081 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.095189 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.095398 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.095546 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.095697 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.095787 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.096018 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.096175 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.096318 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.096440 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.096714 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.096855 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.097098 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.097319 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.097565 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103155) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 07:54:52.097777 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.098031 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.098340 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.098655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.098967 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.099439 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.099763 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.100097 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.100403 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.100712 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.101017 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.101325 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.101646 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.101958 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.102263 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.102568 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.102879 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.103193 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.103538 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.103874 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.104190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.104516 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.104831 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.105169 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.105484 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.105830 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.106154 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.106477 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.106791 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.107127 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.107447 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.107820 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.108057 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.108535 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.108848 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.109164 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.109494 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.109846 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.110157 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.110489 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.110808 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.111131 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.111459 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.111773 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.112132 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.112698 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.113494 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.113846 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.114164 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.114480 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.114800 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.115131 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.115456 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.115790 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.116100 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.116431 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.116756 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.117110 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.117428 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.117823 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.118144 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.118460 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.118773 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.119083 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 07:54:52.119333 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 07:54:52.161858 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO dbcounter [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Registered counter for database nova_api Jul 04 07:54:52.186506 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO dbcounter [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Registered counter for database nova_api Jul 04 07:54:52.280593 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_db.sqlalchemy.engines [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 07:54:52.288579 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writer thread running {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 07:54:52.309714 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 07:54:52.318557 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writer thread running {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 07:54:52.348326 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.context [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38170aea-987e-4b58-8314-95240e7a51a9(cell1) {{(pid=103155) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 07:54:52.352639 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 07:54:52.354304 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 07:54:52.355171 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 07:54:52.357388 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 07:54:52.359593 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO dbcounter [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Registered counter for database nova_cell0 Jul 04 07:54:52.363976 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO dbcounter [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Registered counter for database nova_cell1 Jul 04 07:54:52.373287 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_db.sqlalchemy.engines [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 07:54:52.375332 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_db.sqlalchemy.engines [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 07:54:52.381174 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.context [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38170aea-987e-4b58-8314-95240e7a51a9(cell1) {{(pid=103154) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 07:54:52.385716 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 07:54:52.387401 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writer thread running {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 07:54:52.387555 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 07:54:52.388443 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 07:54:52.389480 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writer thread running {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 07:54:52.390925 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 07:54:52.393209 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO dbcounter [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Registered counter for database nova_cell0 Jul 04 07:54:52.398463 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO dbcounter [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Registered counter for database nova_cell1 Jul 04 07:54:52.406844 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 07:54:52.411330 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 07:54:52.413486 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writer thread running {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 07:54:52.563443 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO dbcounter [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Registered counter for database nova_cell0 Jul 04 07:54:52.566914 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writer thread running {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 07:54:52.574099 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_db.sqlalchemy.engines [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103155) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 07:54:52.578105 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO dbcounter [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Registered counter for database nova_cell0 Jul 04 07:54:52.578893 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writer thread running {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 07:54:52.589248 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 07:54:52.593911 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writer thread running {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 07:54:52.921024 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 07:54:52.921760 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: WARNING keystonemiddleware.auth_token [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 07:54:52.928874 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 07:54:52.929124 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: WARNING keystonemiddleware.auth_token [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 07:54:53.276116 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 07:54:53.279513 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: WARNING keystonemiddleware.auth_token [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 07:54:53.282398 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 07:54:53.285752 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: WARNING keystonemiddleware.auth_token [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 07:54:53.287622 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56545b43f9c0 pid: 103154 (default app) Jul 04 07:54:53.289858 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:54:53.291060 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-5eb7de2f-2fdc-4717-9409-8b4a66a4e8d7 None None] 10.222.0.43 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001886 Jul 04 07:54:53.291324 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56545b43f9c0 pid: 103155 (default app) Jul 04 07:54:53.291476 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 788 bytes} [Mon Jul 4 07:54:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:15.020674 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:15.022789 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003776 Jul 04 07:56:15.024629 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:15 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:15.044544 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_api:SELECT=3 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:56:15.045778 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_cell0:SELECT=3 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:56:15.053553 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_cell1:SELECT=3 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:56:15.054987 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:56:15.521067 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-26b8f31e-8dfa-4cc2-8e7c-34b4b664b731 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:15.552324 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-26b8f31e-8dfa-4cc2-8e7c-34b4b664b731 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.521011 Jul 04 07:56:15.565723 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 2/3] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Jul 4 07:56:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:56:17.659246 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:17.660553 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-6370713c-b904-4dfc-a9b1-1e5d52ad2af5 None None] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002417 Jul 04 07:56:17.660946 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 2/4] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:17.741122 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-eb94a9d3-46ed-42f6-a0c6-5a21c7099f7d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "ram": 256, "swap": 0, "id": "c1", "vcpus": 1}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:17.762298 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 07:56:17.762298 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Jul 04 07:56:17.806521 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-eb94a9d3-46ed-42f6-a0c6-5a21c7099f7d admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.138352 Jul 04 07:56:17.807347 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 3/5] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:56:17.824902 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_api:SELECT=3 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:56:17.825825 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_cell0:SELECT=3 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:56:17.826894 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_cell1:SELECT=3 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:56:17.827698 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:56:18.034018 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-786d87d4-941a-4332-be5f-dea4c6f226e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:18.036418 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 07:56:18.036418 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: warnings.warn(msg) Jul 04 07:56:18.102023 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-786d87d4-941a-4332-be5f-dea4c6f226e4 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.284992 Jul 04 07:56:18.102708 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 3/6] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jul 4 07:56:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 07:56:20.216144 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-eb94a9d3-46ed-42f6-a0c6-5a21c7099f7d admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:20.217923 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-eb94a9d3-46ed-42f6-a0c6-5a21c7099f7d admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002189 Jul 04 07:56:20.218625 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 4/7] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 07:56:20.357265 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-793a87e7-a32b-4f5b-8865-311ac380d830 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M", "ram": 512, "vcpus": 1, "id": "d1"}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:20.376486 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 07:56:20.376486 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: warnings.warn(msg) Jul 04 07:56:20.400369 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-793a87e7-a32b-4f5b-8865-311ac380d830 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.174637 Jul 04 07:56:20.400930 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 4/8] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:56:20.414266 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-29d39419-3831-4d70-bcae-543e3e85c321 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:20.415767 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 07:56:20.415767 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Jul 04 07:56:20.456682 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-29d39419-3831-4d70-bcae-543e3e85c321 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045947 Jul 04 07:56:20.457541 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 5/9] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jul 4 07:56:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:56:22.618020 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-793a87e7-a32b-4f5b-8865-311ac380d830 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:22.619045 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-793a87e7-a32b-4f5b-8865-311ac380d830 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 04 07:56:22.619427 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:22.681555 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-bab20628-dc55-4f76-8bf4-c0e6142d2470 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:22.703621 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-bab20628-dc55-4f76-8bf4-c0e6142d2470 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077557 Jul 04 07:56:22.704937 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 6/11] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 07:56:22.716799 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-8de2b3d2-364e-42a2-bf97-3f0c6b1cdd9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:22.745426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-8de2b3d2-364e-42a2-bf97-3f0c6b1cdd9a admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032504 Jul 04 07:56:22.746255 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 6/12] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jul 4 07:56:22 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:56:24.897954 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-bab20628-dc55-4f76-8bf4-c0e6142d2470 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:24.899085 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-bab20628-dc55-4f76-8bf4-c0e6142d2470 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001765 Jul 04 07:56:24.901673 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 7/13] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:24 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:24.979656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-1fc98c8a-8c2c-4dd8-8492-7049882afcfe admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "d3", "ram": 2048}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:24.997918 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-1fc98c8a-8c2c-4dd8-8492-7049882afcfe admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091784 Jul 04 07:56:24.998646 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 7/14] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:56:25.010915 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-3d6ce728-b234-4af2-b339-6095d0a2eccd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:25.034835 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-3d6ce728-b234-4af2-b339-6095d0a2eccd admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027623 Jul 04 07:56:25.035550 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 8/15] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jul 4 07:56:25 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:56:27.218384 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-1fc98c8a-8c2c-4dd8-8492-7049882afcfe admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:27.219425 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-1fc98c8a-8c2c-4dd8-8492-7049882afcfe admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jul 04 07:56:27.219831 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 8/16] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:27.284153 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-d2119eb7-4cfa-467a-b1e2-dd26d84d1cb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "id": "d4"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:27.304067 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-d2119eb7-4cfa-467a-b1e2-dd26d84d1cb9 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077815 Jul 04 07:56:27.304618 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 9/17] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:56:27.317568 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-3a19e774-6114-4fe5-b58a-5fcf303ecded admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:27.345570 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-3a19e774-6114-4fe5-b58a-5fcf303ecded admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032254 Jul 04 07:56:27.346160 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 9/18] 10.222.0.43 () {64 vars in 1335 bytes} [Mon Jul 4 07:56:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:56:29.460784 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-d2119eb7-4cfa-467a-b1e2-dd26d84d1cb9 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:29.461811 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-d2119eb7-4cfa-467a-b1e2-dd26d84d1cb9 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 04 07:56:29.462170 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 10/19] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:29.525941 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-be66d2eb-f6e6-4cc3-acf2-1a7525aef934 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:29.550373 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-be66d2eb-f6e6-4cc3-acf2-1a7525aef934 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081920 Jul 04 07:56:29.551382 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 10/20] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Jul 4 07:56:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 07:56:31.641249 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-d2119eb7-4cfa-467a-b1e2-dd26d84d1cb9 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:31.642522 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-d2119eb7-4cfa-467a-b1e2-dd26d84d1cb9 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001818 Jul 04 07:56:31.642983 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 11/21] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:31.713127 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-3404e5cf-9ae5-4b23-8276-da5ca1e428f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "vcpus": 1}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:31.735361 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-3404e5cf-9ae5-4b23-8276-da5ca1e428f7 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.085906 Jul 04 07:56:31.735948 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 11/22] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:31 2022] POST /compute/v2.1/flavors => generated 402 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:56:31.750200 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-af31be1a-272c-4122-84a9-3ffac38a4903 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:31.777895 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-af31be1a-272c-4122-84a9-3ffac38a4903 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031429 Jul 04 07:56:31.778485 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 12/23] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jul 4 07:56:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:56:33.907507 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-3404e5cf-9ae5-4b23-8276-da5ca1e428f7 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:33.908855 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-3404e5cf-9ae5-4b23-8276-da5ca1e428f7 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001933 Jul 04 07:56:33.909234 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:33.971005 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-26681371-4db0-4e92-a007-24a6c37fb568 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "ram": 2048}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:33.990892 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-26681371-4db0-4e92-a007-24a6c37fb568 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075204 Jul 04 07:56:33.991451 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 13/25] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:56:34.005693 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-e971275c-3643-4fe0-9166-82522f44d085 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:34.037056 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-e971275c-3643-4fe0-9166-82522f44d085 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036636 Jul 04 07:56:34.037748 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 13/26] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jul 4 07:56:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:56:36.144095 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-26681371-4db0-4e92-a007-24a6c37fb568 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:36.145227 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-26681371-4db0-4e92-a007-24a6c37fb568 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Jul 04 07:56:36.145765 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 14/27] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:36.224039 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-ff14beeb-c22b-4131-b7c3-711ca406b054 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "name": "m1.medium"}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:36.248796 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-ff14beeb-c22b-4131-b7c3-711ca406b054 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.095978 Jul 04 07:56:36.249682 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 14/28] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 07:56:36.262459 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0403da58-4373-4d14-8728-70a38821bc91 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:36.289171 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0403da58-4373-4d14-8728-70a38821bc91 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030451 Jul 04 07:56:36.289780 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 15/29] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jul 4 07:56:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:56:38.420063 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-ff14beeb-c22b-4131-b7c3-711ca406b054 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:38.421054 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-ff14beeb-c22b-4131-b7c3-711ca406b054 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 04 07:56:38.421463 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 15/30] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:38.483646 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-a712b4a8-369c-4a52-983d-275257e962ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:38.503743 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-a712b4a8-369c-4a52-983d-275257e962ef admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076063 Jul 04 07:56:38.504300 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 16/31] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 07:56:38.517235 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-b9e39ad2-96a5-4d7e-a5ce-98800f921b55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:38.541740 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-b9e39ad2-96a5-4d7e-a5ce-98800f921b55 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028655 Jul 04 07:56:38.542636 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 16/32] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jul 4 07:56:38 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 07:56:40.722496 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-a712b4a8-369c-4a52-983d-275257e962ef admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:56:40.724127 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-a712b4a8-369c-4a52-983d-275257e962ef admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002167 Jul 04 07:56:40.724674 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 17/33] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:56:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:56:40.793744 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-7a526f15-f49f-467d-942e-4d1a85812507 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:40.815066 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-7a526f15-f49f-467d-942e-4d1a85812507 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.083889 Jul 04 07:56:40.822024 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 17/34] 10.222.0.43 () {64 vars in 1282 bytes} [Mon Jul 4 07:56:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:56:40.828395 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-83b53213-cd9b-4a21-b5fc-780174ad23fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:56:40.857123 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-83b53213-cd9b-4a21-b5fc-780174ad23fa admin admin] 10.222.0.43 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033201 Jul 04 07:56:40.857909 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 18/35] 10.222.0.43 () {64 vars in 1332 bytes} [Mon Jul 4 07:56:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 07:57:05.246270 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-7a526f15-f49f-467d-942e-4d1a85812507 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:05.247391 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-7a526f15-f49f-467d-942e-4d1a85812507 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 Jul 04 07:57:05.247783 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 18/36] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:57:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:57:05.259189 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:57:05.309888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-9087774a-0fc6-48ba-af80-a1de31497857 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:05.329265 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-9087774a-0fc6-48ba-af80-a1de31497857 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.074917 Jul 04 07:57:05.329895 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 19/37] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Jul 4 07:57:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 07:57:06.273772 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-7a526f15-f49f-467d-942e-4d1a85812507 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:06.274777 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-7a526f15-f49f-467d-942e-4d1a85812507 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 04 07:57:06.275165 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 19/38] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 07:57:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:57:06.467123 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-45292ee5-0948-453c-9a1b-27b339816273 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:06.473291 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.wsgi [None req-45292ee5-0948-453c-9a1b-27b339816273 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-45292ee5-0948-453c-9a1b-27b339816273 admin admin] Request method failure captured: Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Accept: application/json Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Accept-Encoding: gzip, deflate Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Connection: keep-alive Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Content-Length: 0 Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Host: 10.222.0.43 Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Openstack-Api-Version: compute 2.90 Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Openstack-System-Scope: None Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: User-Agent: python-novaclient Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Auth-Token: gAAAAABiwp1STpET10ed5ALVSL4-l6VVzO4avemCzUIjg6XGE1KWJcAGjXguDLLRmDT2OsX4yVRyRXP2ksKTxbEUBRXyYMFLQoacxhSIIM3xqFLbhFkkDb8XZPu5Hu1IxOT41186G0vbUZyh0Da5njC73wKlogqDSnUcM39YjQhMsevrV2tD45g Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Domain-Id: None Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Domain-Name: None Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Identity-Status: Confirmed Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Is-Admin-Project: True Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Domain-Id: default Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Domain-Name: Default Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Name: admin Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Role: member,reader,admin Jul 04 07:57:06.476959 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Roles: member,reader,admin Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf3a0790796c49f294035007b8a8c25a", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Tenant: admin Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Tenant-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Tenant-Name: admin Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User: admin Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Domain-Id: default Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Domain-Name: Default Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Id: aec7b27e85c74490a82ad099b2e0743e Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Name: admin Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: method: > Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: exception: Flavor 42 could not be found. Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: action_args: {'id': '42'} Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 07:57:06.478655 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:06.479888 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.481316 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-45292ee5-0948-453c-9a1b-27b339816273 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 07:57:06.482666 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-45292ee5-0948-453c-9a1b-27b339816273 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066205 Jul 04 07:57:06.482666 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 20/39] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Jul 4 07:57:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 07:57:06.489302 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-8a9983d8-95d6-4c44-be59-2094eecb1dfd admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:06.492295 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:57:06.512371 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-8a9983d8-95d6-4c44-be59-2094eecb1dfd admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026575 Jul 04 07:57:06.512922 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 20/40] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jul 4 07:57:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 07:57:06.523251 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0bc48fbf-273b-4c14-b6b8-1204955b20f2 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:06.544396 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0bc48fbf-273b-4c14-b6b8-1204955b20f2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024791 Jul 04 07:57:06.544960 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 21/41] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jul 4 07:57:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 07:57:06.554885 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-9af6387a-7164-40db-a49e-1eca851839e6 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:06.561208 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.wsgi [None req-9af6387a-7164-40db-a49e-1eca851839e6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-9af6387a-7164-40db-a49e-1eca851839e6 admin admin] Request method failure captured: Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Accept: application/json Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Accept-Encoding: gzip, deflate Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Connection: keep-alive Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Content-Length: 0 Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Host: 10.222.0.43 Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Openstack-Api-Version: compute 2.90 Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Openstack-System-Scope: None Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: User-Agent: python-novaclient Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Auth-Token: gAAAAABiwp1STpET10ed5ALVSL4-l6VVzO4avemCzUIjg6XGE1KWJcAGjXguDLLRmDT2OsX4yVRyRXP2ksKTxbEUBRXyYMFLQoacxhSIIM3xqFLbhFkkDb8XZPu5Hu1IxOT41186G0vbUZyh0Da5njC73wKlogqDSnUcM39YjQhMsevrV2tD45g Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Domain-Id: None Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Domain-Name: None Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Identity-Status: Confirmed Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Is-Admin-Project: True Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Domain-Id: default Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Domain-Name: Default Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Name: admin Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Role: member,reader,admin Jul 04 07:57:06.564686 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Roles: member,reader,admin Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf3a0790796c49f294035007b8a8c25a", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Tenant: admin Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Tenant-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Tenant-Name: admin Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User: admin Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Domain-Id: default Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Domain-Name: Default Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Id: aec7b27e85c74490a82ad099b2e0743e Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Name: admin Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: method: > Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: exception: Flavor 42 could not be found. Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: action_args: {'id': '42'} Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 07:57:06.566320 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:06.567258 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:06.568323 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-9af6387a-7164-40db-a49e-1eca851839e6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 07:57:06.569447 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-9af6387a-7164-40db-a49e-1eca851839e6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014863 Jul 04 07:57:06.569447 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 21/42] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Jul 4 07:57:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 07:57:07.387435 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0bc48fbf-273b-4c14-b6b8-1204955b20f2 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:07.388473 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0bc48fbf-273b-4c14-b6b8-1204955b20f2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 04 07:57:07.388865 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 22/43] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 07:57:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:57:07.581597 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-4afbe470-ea33-417d-bfbe-9768f9cf790b admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:07.588484 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.wsgi [None req-4afbe470-ea33-417d-bfbe-9768f9cf790b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-4afbe470-ea33-417d-bfbe-9768f9cf790b admin admin] Request method failure captured: Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Accept: application/json Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Accept-Encoding: gzip, deflate Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Connection: keep-alive Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Content-Length: 0 Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Host: 10.222.0.43 Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Openstack-Api-Version: compute 2.90 Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Openstack-System-Scope: None Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: User-Agent: python-novaclient Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Auth-Token: gAAAAABiwp1TgB79C4KjYA9c1OKY42iCo-BDVoUX7b4warohWvrAfFHDbk71eLPlfoR4DZ9Yzn-Z2WE14F73RDsBClkwcici3pJ3chNzMhmxioe0DkckbpC6W0IfsVfUvKPXdjFLu9wlVD5-_DBL7yGgTJaMn2E3Tx3vO2vWIwX9riZUR01UME0 Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Domain-Id: None Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Domain-Name: None Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Identity-Status: Confirmed Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Is-Admin-Project: True Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Domain-Id: default Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Domain-Name: Default Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Name: admin Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Role: member,reader,admin Jul 04 07:57:07.590166 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Roles: member,reader,admin Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf3a0790796c49f294035007b8a8c25a", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Tenant: admin Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Tenant-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Tenant-Name: admin Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User: admin Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Domain-Id: default Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Domain-Name: Default Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Id: aec7b27e85c74490a82ad099b2e0743e Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Name: admin Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: method: > Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: exception: Flavor 84 could not be found. Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: action_args: {'id': '84'} Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 07:57:07.591709 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:07.592656 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.594163 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-4afbe470-ea33-417d-bfbe-9768f9cf790b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 07:57:07.595442 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-4afbe470-ea33-417d-bfbe-9768f9cf790b admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065569 Jul 04 07:57:07.595442 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 22/44] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Jul 4 07:57:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 07:57:07.602129 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e4a994df-ce72-4525-beca-dd6d363ece71 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:07.616989 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e4a994df-ce72-4525-beca-dd6d363ece71 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018609 Jul 04 07:57:07.617542 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 23/45] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jul 4 07:57:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 07:57:07.628864 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-888391d7-9945-4bfd-83df-fffcaf747ff2 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:07.643822 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-888391d7-9945-4bfd-83df-fffcaf747ff2 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019536 Jul 04 07:57:07.644368 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jul 4 07:57:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 07:57:07.654210 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-fa1f4595-cc48-4a39-8824-b4fd800bb411 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:07.660627 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.wsgi [None req-fa1f4595-cc48-4a39-8824-b4fd800bb411 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-fa1f4595-cc48-4a39-8824-b4fd800bb411 admin admin] Request method failure captured: Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Accept: application/json Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Accept-Encoding: gzip, deflate Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Connection: keep-alive Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Content-Length: 0 Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Host: 10.222.0.43 Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Openstack-Api-Version: compute 2.90 Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Openstack-System-Scope: None Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: User-Agent: python-novaclient Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Auth-Token: gAAAAABiwp1TgB79C4KjYA9c1OKY42iCo-BDVoUX7b4warohWvrAfFHDbk71eLPlfoR4DZ9Yzn-Z2WE14F73RDsBClkwcici3pJ3chNzMhmxioe0DkckbpC6W0IfsVfUvKPXdjFLu9wlVD5-_DBL7yGgTJaMn2E3Tx3vO2vWIwX9riZUR01UME0 Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Domain-Id: None Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Domain-Name: None Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Identity-Status: Confirmed Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Is-Admin-Project: True Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Domain-Id: default Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Domain-Name: Default Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Name: admin Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Role: member,reader,admin Jul 04 07:57:07.662190 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Roles: member,reader,admin Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf3a0790796c49f294035007b8a8c25a", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Tenant: admin Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Tenant-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Tenant-Name: admin Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User: admin Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Domain-Id: default Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Domain-Name: Default Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Id: aec7b27e85c74490a82ad099b2e0743e Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Name: admin Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: method: > Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: exception: Flavor 84 could not be found. Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: action_args: {'id': '84'} Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 07:57:07.663679 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:07.664514 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:07.665853 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-fa1f4595-cc48-4a39-8824-b4fd800bb411 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 07:57:07.666977 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-fa1f4595-cc48-4a39-8824-b4fd800bb411 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013017 Jul 04 07:57:07.666977 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 24/47] 10.222.0.43 () {60 vars in 1190 bytes} [Mon Jul 4 07:57:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 07:57:08.494019 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-888391d7-9945-4bfd-83df-fffcaf747ff2 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:08.495028 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-888391d7-9945-4bfd-83df-fffcaf747ff2 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 04 07:57:08.495442 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 24/48] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 07:57:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:57:08.686320 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-81c37c9b-cecf-40b5-b299-ed261ddb96e6 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:08.692608 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.wsgi [None req-81c37c9b-cecf-40b5-b299-ed261ddb96e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-81c37c9b-cecf-40b5-b299-ed261ddb96e6 admin admin] Request method failure captured: Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Accept: application/json Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Accept-Encoding: gzip, deflate Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Connection: keep-alive Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Content-Length: 0 Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Host: 10.222.0.43 Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Openstack-Api-Version: compute 2.90 Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Openstack-System-Scope: None Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: User-Agent: python-novaclient Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Auth-Token: gAAAAABiwp1UjD72hROnEs5GYVk3MmLb_AbvfR6D2waV5dd7lHQzjVIVNE33ayb5uA9tKty2v3a8vkQTIz3M-IIVylpNVhoGh_xlRDSwjUkPX91Rux1jIxP1ZIAuF_7h0j7sllwERq_3NuXrC6dKg57xL5v6E9jVrh5Mvi8wOeJkoPoOF0xRM8E Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Domain-Id: None Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Domain-Name: None Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Identity-Status: Confirmed Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Is-Admin-Project: True Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Domain-Id: default Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Domain-Name: Default Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Project-Name: admin Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Role: member,reader,admin Jul 04 07:57:08.694155 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Roles: member,reader,admin Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf3a0790796c49f294035007b8a8c25a", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Tenant: admin Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Tenant-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-Tenant-Name: admin Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User: admin Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Domain-Id: default Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Domain-Name: Default Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Id: aec7b27e85c74490a82ad099b2e0743e Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: X-User-Name: admin Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: method: > Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: exception: Flavor 451 could not be found. Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: action_args: {'id': '451'} Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 07:57:08.695762 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:08.696824 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.698276 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-81c37c9b-cecf-40b5-b299-ed261ddb96e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 07:57:08.699569 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-81c37c9b-cecf-40b5-b299-ed261ddb96e6 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063359 Jul 04 07:57:08.699569 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 25/49] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jul 4 07:57:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 07:57:08.705596 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-bccef562-5f64-4671-ac8b-7c783cb22628 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:08.719670 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-bccef562-5f64-4671-ac8b-7c783cb22628 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017790 Jul 04 07:57:08.720225 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 25/50] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jul 4 07:57:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 07:57:08.730168 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:08.745608 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018996 Jul 04 07:57:08.746172 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 26/51] 10.222.0.43 () {60 vars in 1210 bytes} [Mon Jul 4 07:57:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 07:57:08.757311 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-3e2bde03-1366-4b19-ac7e-0f8e76a8dc4f admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:08.763047 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.wsgi [None req-3e2bde03-1366-4b19-ac7e-0f8e76a8dc4f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-3e2bde03-1366-4b19-ac7e-0f8e76a8dc4f admin admin] Request method failure captured: Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Accept: application/json Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Accept-Encoding: gzip, deflate Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Connection: keep-alive Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Content-Length: 0 Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Host: 10.222.0.43 Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Openstack-Api-Version: compute 2.90 Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Openstack-System-Scope: None Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: User-Agent: python-novaclient Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Auth-Token: gAAAAABiwp1UjD72hROnEs5GYVk3MmLb_AbvfR6D2waV5dd7lHQzjVIVNE33ayb5uA9tKty2v3a8vkQTIz3M-IIVylpNVhoGh_xlRDSwjUkPX91Rux1jIxP1ZIAuF_7h0j7sllwERq_3NuXrC6dKg57xL5v6E9jVrh5Mvi8wOeJkoPoOF0xRM8E Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Domain-Id: None Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Domain-Name: None Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Identity-Status: Confirmed Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Is-Admin-Project: True Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Openstack-Nova-Api-Version: 2.90 Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Domain-Id: default Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Domain-Name: Default Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Project-Name: admin Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Role: member,reader,admin Jul 04 07:57:08.764542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Roles: member,reader,admin Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/cf3a0790796c49f294035007b8a8c25a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_cf3a0790796c49f294035007b8a8c25a", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Tenant: admin Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Tenant-Id: cf3a0790796c49f294035007b8a8c25a Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-Tenant-Name: admin Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User: admin Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Domain-Id: default Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Domain-Name: Default Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Id: aec7b27e85c74490a82ad099b2e0743e Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: X-User-Name: admin Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: method: > Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: exception: Flavor 451 could not be found. Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: action_args: {'id': '451'} Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 07:57:08.766197 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:08.767426 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: ERROR nova.api.openstack.wsgi Jul 04 07:57:08.769159 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-3e2bde03-1366-4b19-ac7e-0f8e76a8dc4f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103155) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 07:57:08.770519 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-3e2bde03-1366-4b19-ac7e-0f8e76a8dc4f admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013020 Jul 04 07:57:08.770519 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 26/52] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jul 4 07:57:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 04 07:57:09.595721 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:09.596723 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 04 07:57:09.597104 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 27/53] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 07:57:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:57:09.789920 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-50dd689d-8076-457f-ba52-002783291b6b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:57:09.810228 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-50dd689d-8076-457f-ba52-002783291b6b admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.076477 Jul 04 07:57:09.810704 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 27/54] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Jul 4 07:57:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:57:10.648946 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:10.650003 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 04 07:57:10.650414 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 07:57:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:57:10.849398 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-bffeb85e-fd37-4a2f-8904-659b953e9576 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:57:10.868761 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-bffeb85e-fd37-4a2f-8904-659b953e9576 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.075596 Jul 04 07:57:10.869223 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 28/56] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Jul 4 07:57:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:57:11.732719 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:11.733767 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 04 07:57:11.734174 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 29/57] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 07:57:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:57:11.932438 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-0233ce5b-16aa-418e-952c-d8f6b49b9b21 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:57:11.955304 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-0233ce5b-16aa-418e-952c-d8f6b49b9b21 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.081630 Jul 04 07:57:11.955870 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 29/58] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Jul 4 07:57:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 07:57:12.845910 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:12.847093 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002701 Jul 04 07:57:12.847492 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 30/59] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 07:57:12 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:57:13.053447 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-2e455639-9410-48d0-a3b6-c79096a6a120 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 07:57:13.073666 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-2e455639-9410-48d0-a3b6-c79096a6a120 admin admin] 10.222.0.43 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.086517 Jul 04 07:57:13.074229 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 30/60] 10.222.0.43 () {64 vars in 1235 bytes} [Mon Jul 4 07:57:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 07:57:13.906051 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:13.907085 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Jul 04 07:57:13.907469 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 31/61] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 07:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:57:14.114298 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-4904e6fa-e714-40ca-a897-de3dd732e86e admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:57:14.134781 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-4904e6fa-e714-40ca-a897-de3dd732e86e admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.089029 Jul 04 07:57:14.135347 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 31/62] 10.222.0.43 () {60 vars in 1202 bytes} [Mon Jul 4 07:57:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 07:58:01.445175 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:58:01.446232 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e4f38da0-3076-4296-b53c-9b6e7164b158 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 04 07:58:01.446589 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 32/63] 10.222.0.43 () {54 vars in 930 bytes} [Mon Jul 4 07:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 07:58:01.457542 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:58:01.509531 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-6b903e82-2a1d-4990-946c-1a19c5df7e84 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:58:01.529328 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-6b903e82-2a1d-4990-946c-1a19c5df7e84 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076374 Jul 04 07:58:01.529889 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 32/64] 10.222.0.43 () {60 vars in 1291 bytes} [Mon Jul 4 07:58:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 07:58:01.555458 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-2cac7da1-d8eb-4882-8b53-6f23c7f5e435 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:58:01.558980 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG dbcounter [-] [103154] Writing DB stats nova_api:SELECT=14 {{(pid=103154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 07:58:01.564729 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-2cac7da1-d8eb-4882-8b53-6f23c7f5e435 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012952 Jul 04 07:58:01.565274 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 33/65] 10.222.0.43 () {60 vars in 1282 bytes} [Mon Jul 4 07:58:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:58:01.577690 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-3bcdc67a-741a-4fc0-853f-a2ee5c4b2374 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:58:01.585836 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-3bcdc67a-741a-4fc0-853f-a2ee5c4b2374 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012291 Jul 04 07:58:01.586408 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 33/66] 10.222.0.43 () {60 vars in 1285 bytes} [Mon Jul 4 07:58:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:58:01.598899 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:58:01.606987 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012067 Jul 04 07:58:01.607491 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 34/67] 10.222.0.43 () {60 vars in 1285 bytes} [Mon Jul 4 07:58:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 07:58:01.619321 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-d006cec4-ef04-495a-a925-74042e1ee157 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 07:58:01.627388 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-d006cec4-ef04-495a-a925-74042e1ee157 admin admin] 10.222.0.43 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011648 Jul 04 07:58:01.627841 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 34/68] 10.222.0.43 () {60 vars in 1282 bytes} [Mon Jul 4 07:58:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:01:19.506118 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:01:19.507162 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 04 08:01:19.507548 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 35/69] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 08:01:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:01:19.650960 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_api:SELECT=6 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:01:19.778514 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-1e668e79-057a-4234-b311-598c9e9e3f81 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:01:19.779684 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 08:01:19.779684 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: warnings.warn(msg) Jul 04 08:01:19.780880 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-1e668e79-057a-4234-b311-598c9e9e3f81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:01:19.781325 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-1e668e79-057a-4234-b311-598c9e9e3f81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:01:19.782142 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-1e668e79-057a-4234-b311-598c9e9e3f81 admin admin] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:01:19.782569 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-1e668e79-057a-4234-b311-598c9e9e3f81 admin admin] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:01:19.817154 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-1e668e79-057a-4234-b311-598c9e9e3f81 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.167722 Jul 04 08:01:19.817748 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 35/70] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jul 4 08:01:19 2022] GET /compute/v2.1/os-services => generated 794 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 08:01:20.662051 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:01:20.663088 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Jul 04 08:01:20.663471 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 36/71] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 08:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:01:20.907027 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-8782515a-7338-462c-8269-8109af0ac947 admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:01:20.908257 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 08:01:20.908257 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: warnings.warn(msg) Jul 04 08:01:20.909465 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-8782515a-7338-462c-8269-8109af0ac947 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:01:20.909936 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-8782515a-7338-462c-8269-8109af0ac947 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:01:20.910729 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-8782515a-7338-462c-8269-8109af0ac947 admin admin] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:01:20.911154 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-8782515a-7338-462c-8269-8109af0ac947 admin admin] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:01:20.931340 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-8782515a-7338-462c-8269-8109af0ac947 admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081000 Jul 04 08:01:20.932033 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 36/72] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jul 4 08:01:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 08:01:32.233099 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:01:32.234149 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 04 08:01:32.234536 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 37/73] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 08:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:01:32.381472 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_cell0:SELECT=4 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:01:32.382227 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_cell1:SELECT=4 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:01:32.383028 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG dbcounter [-] [103155] Writing DB stats nova_api:SELECT=8 {{(pid=103155) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:01:32.435103 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-12b2203e-8702-4d22-9244-bda4a8884c9b admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:01:32.436333 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 08:01:32.436333 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: warnings.warn(msg) Jul 04 08:01:32.437463 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-12b2203e-8702-4d22-9244-bda4a8884c9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:01:32.437930 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-12b2203e-8702-4d22-9244-bda4a8884c9b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:01:32.438717 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-12b2203e-8702-4d22-9244-bda4a8884c9b admin admin] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:01:32.439150 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-12b2203e-8702-4d22-9244-bda4a8884c9b admin admin] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:01:32.465000 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-12b2203e-8702-4d22-9244-bda4a8884c9b admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.090770 Jul 04 08:01:32.465557 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 37/74] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jul 4 08:01:32 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:01:33.324894 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:01:33.325939 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-77926e11-2c01-47ce-8916-63038ab9ac88 admin admin] 10.222.0.43 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 04 08:01:33.326323 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 38/75] 10.222.0.43 () {56 vars in 1074 bytes} [Mon Jul 4 08:01:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:01:33.535466 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG nova.api.openstack.wsgi [None req-a7a46431-cd4f-4f2f-94b0-b92e1081e1ca admin admin] Calling method '>' {{(pid=103155) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:01:33.536623 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 04 08:01:33.536623 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: warnings.warn(msg) Jul 04 08:01:33.537846 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-a7a46431-cd4f-4f2f-94b0-b92e1081e1ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:01:33.538280 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-a7a46431-cd4f-4f2f-94b0-b92e1081e1ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:01:33.539061 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-a7a46431-cd4f-4f2f-94b0-b92e1081e1ca admin admin] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:01:33.539484 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: DEBUG oslo_concurrency.lockutils [None req-a7a46431-cd4f-4f2f-94b0-b92e1081e1ca admin admin] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103155) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:01:33.561329 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: INFO nova.api.openstack.requestlog [None req-a7a46431-cd4f-4f2f-94b0-b92e1081e1ca admin admin] 10.222.0.43 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.093200 Jul 04 08:01:33.561920 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: [pid: 103155|app: 0|req: 38/76] 10.222.0.43 () {60 vars in 1193 bytes} [Mon Jul 4 08:01:33 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:02:32.102911 dv-cinder-797608-42-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 04 08:02:32.103953 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: Mon Jul 4 08:02:32 2022 - graceful shutdown triggered... Jul 04 08:02:32.104496 dv-cinder-797608-42-iscsi devstack@n-api.service[103154]: Gracefully killing worker 1 (pid: 103154)... Jul 04 08:02:32.105098 dv-cinder-797608-42-iscsi devstack@n-api.service[103155]: Gracefully killing worker 2 (pid: 103155)... Jul 04 08:02:33.107141 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: worker 1 buried after 1 seconds Jul 04 08:02:33.107141 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: worker 2 buried after 1 seconds Jul 04 08:02:33.107141 dv-cinder-797608-42-iscsi devstack@n-api.service[103153]: goodbye to uWSGI. Jul 04 08:02:33.108787 dv-cinder-797608-42-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 04 08:02:33.109375 dv-cinder-797608-42-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 04 08:02:33.112282 dv-cinder-797608-42-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 04 08:02:33.122633 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 4 08:02:33 2022] *** Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: nodename: dv-cinder-797608-42-iscsi Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: machine: x86_64 Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: clock source: unix Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: pcre jit disabled Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: detected number of CPU cores: 4 Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: current working directory: / Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: detected binary path: /usr/bin/uwsgi-core Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: your processes number limit is 47680 Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: your memory page size is 4096 bytes Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: detected max file descriptor number: 2048 Jul 04 08:02:33.125325 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: lock engine: pthread robust mutexes Jul 04 08:02:33.126575 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: thunder lock: enabled Jul 04 08:02:33.126575 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 04 08:02:33.126575 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 04 08:02:33.174391 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: Python main interpreter initialized at 0x5584d25519c0 Jul 04 08:02:33.174391 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: python threads support enabled Jul 04 08:02:33.174391 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: your server socket listen backlog is limited to 100 connections Jul 04 08:02:33.174391 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: your mercy for graceful operations on workers is 90 seconds Jul 04 08:02:33.174977 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: mapped 403077 bytes (393 KB) for 2 cores Jul 04 08:02:33.175105 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: *** Operational MODE: preforking *** Jul 04 08:02:33.175501 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: *** uWSGI is running in multiple interpreter mode *** Jul 04 08:02:33.175501 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: spawned uWSGI master process (pid: 117850) Jul 04 08:02:33.175733 dv-cinder-797608-42-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 04 08:02:33.179111 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: spawned uWSGI worker 1 (pid: 117870, cores: 1) Jul 04 08:02:33.179111 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: spawned uWSGI worker 2 (pid: 117871, cores: 1) Jul 04 08:02:33.179111 dv-cinder-797608-42-iscsi devstack@n-api.service[117850]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 04 08:02:33.848801 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 08:02:33.849785 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 04 08:02:35.063313 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 08:02:35.063313 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: from cryptography.utils import int_from_bytes Jul 04 08:02:35.064122 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 08:02:35.064122 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: from cryptography.utils import int_from_bytes Jul 04 08:02:35.082894 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 08:02:35.082894 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: from cryptography.utils import int_from_bytes Jul 04 08:02:35.083509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 04 08:02:35.083509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: from cryptography.utils import int_from_bytes Jul 04 08:02:37.512408 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 08:02:37.513085 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 08:02:37.513177 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 08:02:37.513536 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 08:02:37.513820 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 08:02:37.514250 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.514577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.515034 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.515224 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.515549 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.515857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.516186 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.516502 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.516832 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.517057 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.517406 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.517733 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-42-iscsi {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.518092 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.518398 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.518696 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.519016 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.519318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.519633 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.519942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.520471 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.521254 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.521948 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.522390 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.522745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.523092 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.523367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.523728 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.524019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.524345 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.524681 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.525226 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-42-iscsi {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.525423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.525747 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.526080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.526640 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.526856 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.527095 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.527447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.527763 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.528053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.528403 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.528712 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.529045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.529374 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.529683 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.529997 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.530325 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.530639 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.530958 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.531257 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.531507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.531817 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.532156 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.532476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.532804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.533056 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.533308 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.533653 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.534009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.534290 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.534600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.534902 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.535210 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.535516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.535821 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.535981 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 04 08:02:37.536489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.536656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 04 08:02:37.536803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.536955 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 04 08:02:37.537108 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.537353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 04 08:02:37.537504 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.537700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 04 08:02:37.537700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.538012 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.538156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.538299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.538453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.538619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.538781 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.538927 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.539076 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.539227 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.539384 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.539539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.539700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.539853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.540017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.540176 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.540347 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.540503 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.540682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.540843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.541012 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.541167 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.541733 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-42-iscsi {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.541913 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.542062 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.542231 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.542385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.542539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.542693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.543037 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.543208 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.543354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.543496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.543663 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.543808 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.543951 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.544103 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.544247 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.544390 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.544644 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.544802 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.544975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.545217 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.545377 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.545607 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.545778 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.545921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.546080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.546239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.546392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.546552 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.546697 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.546849 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.546994 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.547150 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.547294 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.547453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.547597 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.547750 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.547901 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.548053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-42-iscsi {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.548219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.548364 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.548507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.548661 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.548812 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.548963 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.549138 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.549138 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.549425 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.549425 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.549771 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.549931 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.550077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.550425 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.550586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.550732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.550922 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.551102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.551406 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.551929 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.552095 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.552248 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.552394 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.552394 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.552679 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.552679 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.553350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.553503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.553683 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.553832 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.553987 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.554144 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.554313 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.554461 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.554613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.554768 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.554920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.555073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.555235 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.555497 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.555647 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.555798 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.555950 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.556108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.556272 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.556428 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.556574 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.556729 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.556878 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.557031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.557186 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.557338 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.557493 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.557672 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.557840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.557986 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.558152 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.558296 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.558448 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.558597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.558757 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.558907 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.559060 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.559211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.559356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.559507 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.559670 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.559823 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.559989 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.560141 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.560293 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.560454 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.560599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.560742 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.560895 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.561048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.561202 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.561375 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.561605 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.562102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.562102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.562406 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.562406 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.562694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.43 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.562694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.43 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.562977 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.563140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.563539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.563705 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.563860 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.564006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.564159 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.564314 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.564469 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.564622 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.564767 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.564926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.565071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.565214 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.565366 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.565540 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.565866 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.566025 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.566181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.566181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.566461 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.566625 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.566770 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.566770 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.567053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.567197 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.567351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.567498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.567641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.567795 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.567946 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.568091 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.568244 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.568397 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.568566 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.568718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.568861 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.569004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.569158 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.569302 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.569447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.569607 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.569775 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.569939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.570103 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.570260 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.570260 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.570562 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.570714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.570857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.571014 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.571167 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.571311 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.571463 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.571631 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.571884 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.572359 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.572511 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.572656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.572830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.572994 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.573149 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.573293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.573848 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.574010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.574168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.574314 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.574479 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.574633 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.574882 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.575131 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.575278 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.575441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.575587 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.575731 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.575899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.576154 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.576313 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.576458 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.576610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.576762 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.576927 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.577086 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.577231 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.577374 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.577530 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.578345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.578525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.578691 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.578854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.579007 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.579153 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.579305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.579455 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.579621 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.579770 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.579921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.580073 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.580237 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.580390 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.580545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.580704 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.580849 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.580993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.581136 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.581280 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.581441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.581587 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.581773 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.582026 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.582538 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.582714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.582875 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.583021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.583021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.583303 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.583447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.583788 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.584078 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.584297 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.584297 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.584587 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.584731 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.584919 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.585137 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 04 08:02:37.585305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.585305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.585587 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.585795 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.585960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.586115 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.586406 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.586564 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.586708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.586853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.587007 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.587174 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.587326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.587472 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.587625 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.587783 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.587935 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.588081 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.588234 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.588385 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.588530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.588690 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.588842 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.589003 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.589148 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.589303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.589455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.589616 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.589787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.589933 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.590076 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.590234 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.590386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.590544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.590689 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.590844 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.591007 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.591152 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.591311 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.591457 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.591601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.591752 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.591896 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.592163 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.592347 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.592900 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.593060 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.593207 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.593352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.593516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.593959 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.594252 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.594404 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.594558 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.594711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.594871 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.594871 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.595155 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.595299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.595444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.595444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.595733 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.595890 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.596042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.596194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.596339 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.596623 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.596788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.596788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.597079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.597079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.597361 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.597507 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.597684 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.597846 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.597991 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.598136 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.598281 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.598424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.598583 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.598728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.598871 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.599015 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.599167 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.599325 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.599483 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.599630 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.599912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.600134 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.600293 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.600457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.600619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.600772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.600924 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.601076 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.601220 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.601373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.601518 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.601707 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.601858 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.602013 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.602176 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.602433 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.602599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.603105 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.603258 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.603411 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.603564 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.603722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.603886 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.604240 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.604517 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.604675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.604675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.605066 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.605219 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.605372 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.605531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.605716 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.605880 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.606034 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.606190 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.606409 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.606568 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.606871 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.607034 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.607201 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.607348 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.607500 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.607645 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.607789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.607944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.608089 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.608241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.608393 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.608545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.608699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.608844 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.608999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.609162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.609308 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.609465 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.609674 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.609839 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.609985 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.610129 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.610274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.610426 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.610581 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.610726 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.610880 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.611035 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.611188 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.611339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.611339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.611635 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.611787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.611943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.612096 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.612252 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.612417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.612709 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.612883 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.613500 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.613824 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.614000 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.614165 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.614560 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.614560 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.614994 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.615152 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.615368 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.615368 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.615667 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.615812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.615964 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.616116 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.616290 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.616439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.616597 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.616743 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.616907 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.617224 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.617385 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.617531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.617699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.617848 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.618006 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.618165 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.618335 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.618496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.618642 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.618794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.618939 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.619097 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.619252 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.619411 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.619570 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.619715 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.619859 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.620011 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.620156 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.620327 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.620472 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.620617 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.620772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.620917 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.621069 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.621352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.621507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.621736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.621898 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.622051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.622197 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.622351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.622517 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.622686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.622988 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.623618 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.623772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.623925 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.624079 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.624230 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.624411 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.624794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.625106 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.625256 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.625418 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.625584 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.625766 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.625923 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.626075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.626219 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.626364 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.626523 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.626672 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.626816 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.626969 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.627113 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.627765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.627930 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.628094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.628240 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.628392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.628537 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.628682 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.628840 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.628997 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.629150 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.629303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.629466 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.629668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.629820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.629988 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.630140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.630293 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.630446 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.630617 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.630973 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.631221 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.631429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.631429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.631429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.631848 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.632000 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.632153 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.632309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.632462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.632606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.632765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.632936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.633208 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.633879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.634043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.634192 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.634350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.634504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.634733 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.634982 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.635274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.635441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.635607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.635752 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.635905 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.636063 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.636209 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.636383 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.637127 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.637282 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.637440 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.637741 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.638015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.638187 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.638885 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.639049 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.639212 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.639365 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.639523 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.639668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.639813 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.639957 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.640116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.640278 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.640439 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.640596 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.640742 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.640912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.641161 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.641318 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.641469 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.641648 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.641818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.641977 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.642142 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.642302 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.642461 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.642628 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.642628 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.642950 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.643101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.643387 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.643895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.644056 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.644297 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.644471 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.644624 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.644777 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.644927 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.645194 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.645350 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.645529 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.645704 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.645879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.646047 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.646222 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.646390 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.646586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.646793 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.646947 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.647107 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.647283 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.647479 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.647665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.647842 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.648024 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.648350 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.648565 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.648738 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.648894 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.649046 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.649205 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.649360 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.649525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.649713 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.649880 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.650052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.650213 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.650372 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.650535 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.650694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.650854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.651006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.651181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.651445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.651612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.651772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.651925 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.652084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.652248 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.652408 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.652573 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.652732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.652891 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.653052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.653213 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.653390 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.654089 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.654254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.654422 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.654422 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.654720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.654895 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.655055 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.655227 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.655480 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.655645 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.655806 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.655971 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.656123 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.656285 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.656285 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.656572 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.656725 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.656885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.657048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.657207 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.657360 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.657567 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.657756 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.657923 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.658085 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.658236 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.658510 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.658668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.658830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.658982 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.659153 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.659313 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.659483 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.659665 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.659830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.659989 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.660141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.660300 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.660462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.660615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.660774 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.660934 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.661087 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.661259 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.661433 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.661727 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.661888 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.662039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.662251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.662503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.662667 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.662818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.662978 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.663136 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.663288 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.663288 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.663622 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.663622 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.663622 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.664538 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.664691 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.664898 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.665052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.665211 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.665362 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.665651 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.665826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.665987 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.666146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.666310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.666462 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.666620 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.666782 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.666942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.667094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.667245 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.667410 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.667571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.667734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.667734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.668039 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.668200 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.668352 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.668352 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.668776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.668776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.669079 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.669238 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.669400 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.669565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.669789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.669952 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.670131 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.671181 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.671358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.671527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.671707 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.671946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.672120 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.672273 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.672425 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.672590 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.672744 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.672895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.673048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.673208 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.673362 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.673612 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.674043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.674922 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.675097 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.675258 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.675412 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.675573 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.675838 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.676003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.676003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.676305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.676305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.676616 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.676786 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.676938 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.677090 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.677242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.677403 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.677565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.677742 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.678026 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.678254 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.678417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.678583 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.678735 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.679038 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.679207 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.679367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.679521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.679684 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.679843 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.679996 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.680146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.680146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.680446 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.680600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.680751 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.680950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.681125 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.681286 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.681454 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.681606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.681926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.682171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.682171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.682475 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.682722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.682877 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.683028 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.683187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.683338 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.683503 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.683669 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.683823 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.683980 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.684242 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.684794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.684965 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.685121 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.685274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.685425 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.685577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.685752 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.686032 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.686202 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.686355 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.686505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.686659 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.686810 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.686977 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.687129 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.687281 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.687439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.687592 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.687745 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.687745 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.688049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.688212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.688372 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.688525 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.688686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.688846 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.689024 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.689286 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.689457 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.689609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.689822 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.689976 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.690128 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.690290 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.690442 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.690600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.690761 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.690914 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.691065 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.691224 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.691386 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.691545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.691711 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.691865 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.692017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.692185 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.692516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.692711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.692711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.693009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.693168 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.693321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.693509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.693700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.693858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.694019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.694171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.694434 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.694965 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.695153 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.695308 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.695467 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.695619 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.695770 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.695937 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.696223 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.696383 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.696544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.696696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.696849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.697642 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.697826 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.697988 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.697988 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.698303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.698462 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.698621 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.699031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.699203 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.699525 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.699685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.699836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.699996 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.700162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.700331 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.700492 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.700653 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.700804 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.700964 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.701115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.701278 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.701443 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.701603 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.701603 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.701980 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.702145 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.702316 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.702488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.702741 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.702899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.702899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.703186 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.703351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.703351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.703656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.703817 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.703970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.704132 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.704132 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.704460 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.704741 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.705361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.705568 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.705568 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.705904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.706056 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.706232 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.706504 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.706504 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.706816 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.706969 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.706969 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.707283 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.707444 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.707606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.707772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.707772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.708161 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.708324 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.708491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.708695 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.708695 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.708989 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.709230 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.709419 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.709822 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.709822 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.710172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.710329 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.710487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.710654 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.711137 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.711350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.711350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.711730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.711893 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.712115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.712552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.712552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.712991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713348 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713446 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713533 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713782 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713884 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.713968 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714203 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714307 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714402 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714498 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714498 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714666 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714782 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714782 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.714979 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.715424 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.715532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.715532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.715701 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.715701 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.715876 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.715965 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716137 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716137 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716313 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716402 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.716975 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.717062 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.717062 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.717234 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.717330 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.717417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.717502 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.717502 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.717803 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.717943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.718096 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.718194 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.718194 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.718394 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.718518 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.718648 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.718802 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.718802 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.718989 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719076 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719161 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719264 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719438 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719438 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719688 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719802 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.719899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720066 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720066 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720234 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720234 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720410 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720497 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720582 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720939 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.720939 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721105 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721192 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721291 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721633 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721739 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721739 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721905 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.721993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722172 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722267 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722520 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722606 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722698 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.722970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723057 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723144 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723237 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723323 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723417 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723819 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.723943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.724094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.724094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.724303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.724303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.724475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.724609 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.724778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.724908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.725041 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.725126 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.725211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.725523 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.725661 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.725754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.725754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.725909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.725995 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726090 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726178 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726363 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726363 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726538 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726633 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726633 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726790 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726790 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726946 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.726946 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727116 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727202 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727380 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727467 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727562 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727644 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727719 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727803 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727896 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.727896 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728055 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728150 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728235 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728327 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728413 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728771 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.728941 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729026 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729381 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729560 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729671 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729887 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.729887 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.730126 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.730242 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.730368 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.730447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.730447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.730628 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.730745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.730871 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.730992 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731110 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731209 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731209 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731473 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731473 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731627 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731885 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.731885 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732143 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732236 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732329 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732329 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732601 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.732922 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733010 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733156 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733156 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733285 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733370 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733370 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733526 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733611 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733726 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733801 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733894 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.733988 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734092 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734259 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734331 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734331 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734587 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734673 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.734930 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735107 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735188 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735188 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735327 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735401 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735401 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735638 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735800 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.735800 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.736077 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.736152 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.736152 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.736298 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.736380 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.736461 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.736542 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.737103 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.737448 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.737549 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.737843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.737928 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.738152 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.738235 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.738480 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.738580 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.738790 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.738880 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.739104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.739195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.739415 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.739516 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.739733 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.739816 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.740048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.740326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.740413 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.740821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.741139 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.741765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.742021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.742145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.742371 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.742475 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.742686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.742788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.742998 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.743303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.743408 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.743487 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.743615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.743737 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.743929 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.744029 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.744272 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.744444 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.744573 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.744782 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.744900 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.745109 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.745244 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.745435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.745550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.745873 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.745971 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.746195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.746300 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.746509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.746621 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.746870 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.746979 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.747206 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.747305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.747494 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.747591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.747809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.747920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.748124 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.748220 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.748438 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.748583 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.748730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.748872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.749046 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.749190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.749358 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.749493 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.749692 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.749842 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.750005 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.750140 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.750313 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.750554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.750704 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.750879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.751014 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.751206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.751341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.751532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.751684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.751852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.751985 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.752163 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.752635 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.752813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.752949 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.753126 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.753269 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.753451 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.753678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.753898 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.754047 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.754314 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.754636 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.754771 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.754959 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.755105 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.755276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.755446 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.755580 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.755789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.755950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.756146 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.756301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.756442 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.756581 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.756746 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.756943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.757080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.757212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.757370 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.757505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.757712 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.757874 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.758018 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.758158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.758323 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.758458 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.758640 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.758784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.758950 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.759092 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.759260 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.759486 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.759621 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.759839 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.759975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.760154 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.760296 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.760477 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.760625 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.760765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.760886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.761078 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.761219 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.761385 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.761530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.761734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.761868 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.762040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.762176 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.762344 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.762539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.762689 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.762823 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.762954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.763084 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.763244 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.763393 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.763534 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.763668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.763838 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.763975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.764145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.764282 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.764504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.764630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.764761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.764893 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.765037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.765170 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.765337 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.765480 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.765673 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.765824 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.765965 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.766097 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.766252 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.766399 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.766557 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.766701 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.766857 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.766993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.767159 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.767304 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.767462 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.767618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.767758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.767915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.768050 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.768228 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.768362 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.768540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.768684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.768853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.768995 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.769164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.769298 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.769476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.769612 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.769906 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.770045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.770177 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.770317 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.770450 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.770583 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.770757 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.770892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.771054 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.771202 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.771370 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.771544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.771828 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.772013 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.772166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.772309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.772441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.772572 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.772751 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.772896 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.773098 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.773246 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.773412 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.773556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.773890 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.774018 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.774232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.774369 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.774600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.774743 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.774876 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.775007 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.775182 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.775325 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.775514 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.775648 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.775814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.775948 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.776117 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.776246 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.776435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.776570 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.776743 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.776889 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.777049 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.777184 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.777354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.777488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.777682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.777836 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.777990 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.778124 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.778296 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.778419 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.778599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.778731 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.778908 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.779055 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 08:02:37.779376 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.779515 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.779793 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.780096 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.780399 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.780708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.781051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.781507 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.781686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.782096 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.782310 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.782617 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.782920 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.783225 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.783526 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.783833 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.784161 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.784470 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.784772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.785293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.785601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.785936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.786259 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.786557 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.786873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.787243 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.787553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.787869 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.788175 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.788502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.788847 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.789246 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.789495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.790433 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.790757 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.791064 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.791375 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.791702 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.792011 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.792316 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.792619 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.792925 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.793225 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.793530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.793858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.794161 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.794466 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.794846 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.795065 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.795364 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.795664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.795965 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.796272 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.796575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.796873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.797176 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.797473 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.797799 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.798099 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.798431 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.798782 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.799094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.799414 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.799720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.800040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.800348 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.800666 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.800986 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.801302 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.801613 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.801965 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.802269 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.802643 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.802907 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.803215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.803532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.803833 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.804158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.804481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.804795 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.805120 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.805430 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.805769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.806081 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.806389 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.806720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.807025 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.807329 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.807640 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.807943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.808258 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.808577 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.808889 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.809216 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.809534 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.809864 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.810188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.810511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.811332 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.811332 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.811694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.811877 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.812211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.812450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.812750 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 04 08:02:37.812976 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 04 08:02:37.841723 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO dbcounter [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Registered counter for database nova_api Jul 04 08:02:37.863613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_db.sqlalchemy.engines [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 08:02:37.871145 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writer thread running {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 08:02:37.874400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO dbcounter [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Registered counter for database nova_api Jul 04 08:02:37.895747 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_db.sqlalchemy.engines [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 08:02:37.903668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writer thread running {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 08:02:37.928837 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.context [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38170aea-987e-4b58-8314-95240e7a51a9(cell1) {{(pid=117870) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 08:02:37.933056 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:02:37.934690 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:02:37.935497 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:02:37.937465 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:02:37.939518 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO dbcounter [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Registered counter for database nova_cell0 Jul 04 08:02:37.943811 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO dbcounter [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Registered counter for database nova_cell1 Jul 04 08:02:37.952140 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_db.sqlalchemy.engines [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 08:02:37.955489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_db.sqlalchemy.engines [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 08:02:37.958550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.context [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),38170aea-987e-4b58-8314-95240e7a51a9(cell1) {{(pid=117871) load_cells /opt/stack/nova/nova/context.py:464}} Jul 04 08:02:37.963032 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:02:37.963565 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writer thread running {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 08:02:37.964606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:02:37.964849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writer thread running {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 08:02:37.965405 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:02:37.967483 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:02:37.969503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO dbcounter [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Registered counter for database nova_cell0 Jul 04 08:02:37.973523 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO dbcounter [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Registered counter for database nova_cell1 Jul 04 08:02:37.981046 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_db.sqlalchemy.engines [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 08:02:37.982387 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_db.sqlalchemy.engines [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 08:02:37.989391 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writer thread running {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 08:02:37.991100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writer thread running {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 08:02:38.114449 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO dbcounter [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Registered counter for database nova_cell0 Jul 04 08:02:38.126892 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_db.sqlalchemy.engines [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 08:02:38.132396 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writer thread running {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 08:02:38.141575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO dbcounter [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Registered counter for database nova_cell0 Jul 04 08:02:38.149409 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_db.sqlalchemy.engines [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 04 08:02:38.155254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writer thread running {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 04 08:02:38.464120 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: WARNING keystonemiddleware.auth_token [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 08:02:38.471061 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: WARNING keystonemiddleware.auth_token [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 08:02:38.471722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: WARNING keystonemiddleware.auth_token [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 08:02:38.478593 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: WARNING keystonemiddleware.auth_token [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 08:02:38.824376 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: WARNING keystonemiddleware.auth_token [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 08:02:38.827895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: WARNING keystonemiddleware.auth_token [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 04 08:02:38.830467 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: WARNING keystonemiddleware.auth_token [None req-6b826128-c209-4b15-81c3-e726a7f74f48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 08:02:38.833598 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: WARNING keystonemiddleware.auth_token [None req-07bd5188-2ccc-4cf7-bfcb-a8b8a707c09d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 04 08:02:38.836282 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5584d25519c0 pid: 117870 (default app) Jul 04 08:02:38.839701 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5584d25519c0 pid: 117871 (default app) Jul 04 08:03:23.351606 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:03:23.352707 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:03:23.354892 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:03:23.356821 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:03:24.980388 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ae5e1d2c-e1e8-41a9-905c-f2ae9895ff70 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Action: 'create', calling method: .version_select at 0x7f05e768a700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-630168234"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:03:28.408908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ae5e1d2c-e1e8-41a9-905c-f2ae9895ff70 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 5.064725 Jul 04 08:03:28.410189 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 1/1] 10.222.0.43 () {60 vars in 1154 bytes} [Mon Jul 4 08:03:23 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 5068 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 04 08:03:29.052492 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-81be9f60-0227-4855-91e1-23000fb2554f tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e773c280>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:29.149073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:03:29.154808 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:03:29.157901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:03:29.158778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:03:30.658853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-81be9f60-0227-4855-91e1-23000fb2554f tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea" status: 200 len: 345 microversion: 2.1 time: 2.237126 Jul 04 08:03:30.673402 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 1/2] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:03:28 2022] GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea => generated 345 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:30.680790 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d18b476e-938b-4eb1-a0f3-07ac577a4711 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Action: 'create', calling method: .version_select at 0x7f05e754f4c0>, body: {"snapshot": {"volume_id": "3fe6936b-8d01-467c-ba21-532b58b85eea", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-335789308"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:03:32.168226 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d18b476e-938b-4eb1-a0f3-07ac577a4711 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.493730 Jul 04 08:03:32.169570 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 2/3] 10.222.0.43 () {60 vars in 1161 bytes} [Mon Jul 4 08:03:30 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:03:32.194876 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4a0b450f-1ef2-47c8-97ee-57dfec7a89e9 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e758e5e0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:32.282017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4a0b450f-1ef2-47c8-97ee-57dfec7a89e9 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 200 len: 286 microversion: 2.1 time: 0.100971 Jul 04 08:03:32.292541 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:32 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:32.297406 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9c688c86-02ed-440c-a988-55d1f715c6c4 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e754f550>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:32.468894 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9c688c86-02ed-440c-a988-55d1f715c6c4 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.176179 Jul 04 08:03:32.469974 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 3/5] 10.222.0.43 () {58 vars in 1139 bytes} [Mon Jul 4 08:03:32 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:03:32.492526 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6640486d-1096-4ac0-b394-1148f2c16538 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e758e670>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:32.587255 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6640486d-1096-4ac0-b394-1148f2c16538 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 200 len: 286 microversion: 2.1 time: 0.106528 Jul 04 08:03:32.588237 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 3/6] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:32 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:33.612357 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e5b94b85-4de5-4a65-a98b-b7ab6be23eaf tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e756c280>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:33.708066 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e5b94b85-4de5-4a65-a98b-b7ab6be23eaf tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 200 len: 286 microversion: 2.1 time: 0.106393 Jul 04 08:03:33.729523 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:33 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:34.746835 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b6be9ea9-20b0-4846-85ec-c046a78f1874 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e758edc0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:35.305096 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b6be9ea9-20b0-4846-85ec-c046a78f1874 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 200 len: 286 microversion: 2.1 time: 0.566180 Jul 04 08:03:35.306160 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:34 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 286 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:36.321184 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-62b7044d-9347-4804-82dd-2f53159600d3 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e756c9d0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:36.424130 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-62b7044d-9347-4804-82dd-2f53159600d3 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 200 len: 286 microversion: 2.1 time: 0.110059 Jul 04 08:03:36.426228 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 5/9] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:36 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:37.447229 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9ee757c1-1087-4095-a942-ed124b22df46 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e755a4c0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:37.657363 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9ee757c1-1087-4095-a942-ed124b22df46 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 200 len: 286 microversion: 2.1 time: 0.221034 Jul 04 08:03:37.664224 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 5/10] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:37 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 286 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:38.676295 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9a0b8e15-4843-4cc7-a13a-11f034b8386e tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e754f310>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:38.758349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9a0b8e15-4843-4cc7-a13a-11f034b8386e tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 200 len: 287 microversion: 2.1 time: 0.089328 Jul 04 08:03:38.760133 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 6/11] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:38 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:38.775401 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b86bb49e-8735-4a43-a849-3ea288a7127b tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e755ab80>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:39.056812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b86bb49e-8735-4a43-a849-3ea288a7127b tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "DELETE /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 202 len: 0 microversion: 2.1 time: 0.289494 Jul 04 08:03:39.058829 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1253 bytes} [Mon Jul 4 08:03:38 2022] DELETE /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:03:39.070499 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-502f0fdb-d369-4e68-866a-615a8e81e677 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e754f9d0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:39.158466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-502f0fdb-d369-4e68-866a-615a8e81e677 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 200 len: 286 microversion: 2.1 time: 0.094839 Jul 04 08:03:39.160177 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:39 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 286 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:40.176992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b6ed09cf-ddba-49e2-9f02-30504174a668 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e758ed30>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:40.302377 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b6ed09cf-ddba-49e2-9f02-30504174a668 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 200 len: 286 microversion: 2.1 time: 0.132843 Jul 04 08:03:40.308562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 7/14] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:40 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:41.210540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-93814d30-c941-482a-aa09-22acd2261586 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: .version_select at 0x7f05e756caf0>, body: {"keypair": {"name": "tempest-keypair-1498478526", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAGm1hc6a9IlWGOkHQJA2NuJBv3sO9y7s1CibyTiXXIwnkz/J/rXD75en+tTx++th7ryLPEeo9ZBTHqNnRrmDAjifd+yb5qthY9K75jNGGXAo7A4zss7Jwux9i66C2Rt/g=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:03:41.568791 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-93814d30-c941-482a-aa09-22acd2261586 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for project de5226d001fb47b399172b6633fec844. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:03:41.652875 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-93814d30-c941-482a-aa09-22acd2261586 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for user 126ba607541e4c4895b47b4b7602ce01 and project de5226d001fb47b399172b6633fec844. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:03:41.874602 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-93814d30-c941-482a-aa09-22acd2261586 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.537021 Jul 04 08:03:41.878103 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 8/15] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:03:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:03:41.892881 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5e788649-d162-4830-b676-940d3b8ec22e tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e74c09d0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:41.976959 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-5e788649-d162-4830-b676-940d3b8ec22e tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] HTTP exception thrown: Snapshot 30fb8c44-4abb-43a8-8c1a-0a2daed7e750 could not be found. Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5e788649-d162-4830-b676-940d3b8ec22e tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Request method failure captured: Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 HTTP/1.1 Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7L7iF2PLAizRZAC6MPZsYSwv6jUZ9a3vmV94D3prWE8hV9RRDUkR1RvwS-Vd1yEko01hsbenLsB7JJyVd0viEY94VAZy0t5QhpSPikhOQD27TT7H1-9KI5jeM-vCsQ4MMY9S2i_smuaR2ZjqtpgLXaoB52WBDEpzrrVNRqHkplrDI Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 784a07c025314f0ebd6dc72bd77cc5d9 Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:03:41.982641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_784a07c025314f0ebd6dc72bd77cc5d9", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 784a07c025314f0ebd6dc72bd77cc5d9 Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesSnapshotsTestJSON-1352896822-project Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 7ed5cb5412ba4988a12fefb7aaa824c0 Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1352896822-project Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Snapshot 30fb8c44-4abb-43a8-8c1a-0a2daed7e750 could not be found. Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '30fb8c44-4abb-43a8-8c1a-0a2daed7e750'} Jul 04 08:03:41.985185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 30fb8c44-4abb-43a8-8c1a-0a2daed7e750 could not be found. (HTTP 404) (Request-ID: req-a335069a-2879-4da4-813f-f0ec16ee2fc0) Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:41.986662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:03:41.988908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 30fb8c44-4abb-43a8-8c1a-0a2daed7e750 could not be found. Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 04 08:03:41.991020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 30fb8c44-4abb-43a8-8c1a-0a2daed7e750 could not be found. Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 30fb8c44-4abb-43a8-8c1a-0a2daed7e750 could not be found. Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:41.995762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5e788649-d162-4830-b676-940d3b8ec22e tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Returning 404 to user: Snapshot 30fb8c44-4abb-43a8-8c1a-0a2daed7e750 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:03:41.998861 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5e788649-d162-4830-b676-940d3b8ec22e tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750" status: 404 len: 111 microversion: 2.1 time: 0.117393 Jul 04 08:03:42.004998 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 9/16] 10.222.0.43 () {58 vars in 1250 bytes} [Mon Jul 4 08:03:41 2022] GET /compute/v2.1/os-snapshots/30fb8c44-4abb-43a8-8c1a-0a2daed7e750 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:03:42.025770 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-50c4137c-e9be-4aa2-bb59-b5a18ce03791 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e74c09d0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:42.356822 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-50c4137c-e9be-4aa2-bb59-b5a18ce03791 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea" status: 202 len: 0 microversion: 2.1 time: 0.341131 Jul 04 08:03:42.360981 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 10/17] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:03:42 2022] DELETE /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:03:42.366932 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-baf814ae-93c3-457f-80ee-fa856a7c0930 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e74c0790>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:42.385981 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0f13089-4bc0-4af8-a729-11cc1fddcc46 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'create', calling method: .version_select at 0x7f05e758e670>, body: {"keypair": {"name": "tempest-keypair-764593724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaj2RVhgJWDpkdvBe/M9SQaUWhx2nr9iS4HBFr/uJg1hx1jk0gFRu00IRcL8GaNgFR3V8bVzFiqdryjR2fE6rPICPT7I/KHkSzWzGLxb5wmlFUafX7a5POS8ouQKCvsoQ=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:03:42.538789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-baf814ae-93c3-457f-80ee-fa856a7c0930 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea" status: 200 len: 344 microversion: 2.1 time: 0.176459 Jul 04 08:03:42.539488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 11/18] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:03:42 2022] GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea => generated 344 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:03:42.594510 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-a0f13089-4bc0-4af8-a729-11cc1fddcc46 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Getting quotas for project 34a4b394ba684ed2a67d14b4a5b24f2f. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:03:42.650439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-a0f13089-4bc0-4af8-a729-11cc1fddcc46 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Getting quotas for user 18b1072539af49729dff7ee9ea445c77 and project 34a4b394ba684ed2a67d14b4a5b24f2f. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:03:42.961964 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a0f13089-4bc0-4af8-a729-11cc1fddcc46 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 2.076810 Jul 04 08:03:42.971513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 8/19] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:03:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 2089 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:03:43.556359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a44ea983-0c23-47a9-8b65-4890cd93b391 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e6c47700>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:44.646232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-a44ea983-0c23-47a9-8b65-4890cd93b391 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] HTTP exception thrown: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a44ea983-0c23-47a9-8b65-4890cd93b391 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Request method failure captured: Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea HTTP/1.1 Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7L7iF2PLAizRZAC6MPZsYSwv6jUZ9a3vmV94D3prWE8hV9RRDUkR1RvwS-Vd1yEko01hsbenLsB7JJyVd0viEY94VAZy0t5QhpSPikhOQD27TT7H1-9KI5jeM-vCsQ4MMY9S2i_smuaR2ZjqtpgLXaoB52WBDEpzrrVNRqHkplrDI Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 784a07c025314f0ebd6dc72bd77cc5d9 Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:03:44.648365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_784a07c025314f0ebd6dc72bd77cc5d9", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 784a07c025314f0ebd6dc72bd77cc5d9 Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesSnapshotsTestJSON-1352896822-project Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 7ed5cb5412ba4988a12fefb7aaa824c0 Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1352896822-project Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '3fe6936b-8d01-467c-ba21-532b58b85eea'} Jul 04 08:03:44.650779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. (HTTP 404) (Request-ID: req-c398aa89-65f6-4157-8002-e325f69ab9e2) Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:44.653171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:03:44.655219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 08:03:44.657043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a44ea983-0c23-47a9-8b65-4890cd93b391 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Returning 404 to user: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:03:44.658818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a44ea983-0c23-47a9-8b65-4890cd93b391 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea" status: 404 len: 109 microversion: 2.1 time: 1.101452 Jul 04 08:03:44.660699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 12/20] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:03:43 2022] GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea => generated 109 bytes in 1112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:03:44.671007 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-910354c5-b0ac-4694-a50f-ae000bd21a59 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e75319d0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:45.443878 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-910354c5-b0ac-4694-a50f-ae000bd21a59 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] HTTP exception thrown: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-910354c5-b0ac-4694-a50f-ae000bd21a59 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Request method failure captured: Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea HTTP/1.1 Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7L7iF2PLAizRZAC6MPZsYSwv6jUZ9a3vmV94D3prWE8hV9RRDUkR1RvwS-Vd1yEko01hsbenLsB7JJyVd0viEY94VAZy0t5QhpSPikhOQD27TT7H1-9KI5jeM-vCsQ4MMY9S2i_smuaR2ZjqtpgLXaoB52WBDEpzrrVNRqHkplrDI Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 784a07c025314f0ebd6dc72bd77cc5d9 Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:03:45.449970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_784a07c025314f0ebd6dc72bd77cc5d9", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 784a07c025314f0ebd6dc72bd77cc5d9 Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesSnapshotsTestJSON-1352896822-project Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 7ed5cb5412ba4988a12fefb7aaa824c0 Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1352896822-project Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '3fe6936b-8d01-467c-ba21-532b58b85eea'} Jul 04 08:03:45.451100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. (HTTP 404) (Request-ID: req-24ee4cab-1ba6-4a96-99ce-915b4bc96f4f) Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:45.451722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 08:03:45.452736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 08:03:45.453780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.454710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.457453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-910354c5-b0ac-4694-a50f-ae000bd21a59 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Returning 404 to user: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:03:45.462254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-910354c5-b0ac-4694-a50f-ae000bd21a59 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea" status: 404 len: 109 microversion: 2.1 time: 0.798669 Jul 04 08:03:45.468230 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 9/21] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:03:44 2022] DELETE /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea => generated 109 bytes in 806 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:03:45.482350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ec20b02d-72f6-42ae-8c77-21fc9b9c2948 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Calling method '.version_select at 0x7f05e7f31a60>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:45.630464 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-ec20b02d-72f6-42ae-8c77-21fc9b9c2948 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] HTTP exception thrown: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ec20b02d-72f6-42ae-8c77-21fc9b9c2948 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Request method failure captured: Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea HTTP/1.1 Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7L7iF2PLAizRZAC6MPZsYSwv6jUZ9a3vmV94D3prWE8hV9RRDUkR1RvwS-Vd1yEko01hsbenLsB7JJyVd0viEY94VAZy0t5QhpSPikhOQD27TT7H1-9KI5jeM-vCsQ4MMY9S2i_smuaR2ZjqtpgLXaoB52WBDEpzrrVNRqHkplrDI Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 784a07c025314f0ebd6dc72bd77cc5d9 Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:03:45.632528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/784a07c025314f0ebd6dc72bd77cc5d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_784a07c025314f0ebd6dc72bd77cc5d9", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 784a07c025314f0ebd6dc72bd77cc5d9 Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1352896822 Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesSnapshotsTestJSON-1352896822-project Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 7ed5cb5412ba4988a12fefb7aaa824c0 Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1352896822-project Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '3fe6936b-8d01-467c-ba21-532b58b85eea'} Jul 04 08:03:45.633912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. (HTTP 404) (Request-ID: req-247dada7-74c3-4647-9317-2839e3165ef0) Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:45.634750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:03:45.635966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 08:03:45.637722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ec20b02d-72f6-42ae-8c77-21fc9b9c2948 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] Returning 404 to user: Volume 3fe6936b-8d01-467c-ba21-532b58b85eea could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ec20b02d-72f6-42ae-8c77-21fc9b9c2948 tempest-VolumesSnapshotsTestJSON-1352896822 tempest-VolumesSnapshotsTestJSON-1352896822-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea" status: 404 len: 109 microversion: 2.1 time: 0.159699 Jul 04 08:03:45.639698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 13/22] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:03:45 2022] GET /compute/v2.1/os-volumes/3fe6936b-8d01-467c-ba21-532b58b85eea => generated 109 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:03:46.170734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-108044174", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "networks": [{"uuid": "e541c377-482c-4dd2-91c7-8de998dbc62e"}]}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:03:46.570230 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] validate_networks() for [('e541c377-482c-4dd2-91c7-8de998dbc62e', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:03:49.636524 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7bc26e8b-c76c-4ef3-a46f-498b5c9ba664 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'create', calling method: .version_select at 0x7f05e74c08b0>, body: {"keypair": {"name": "tempest-keypair-1080070208", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfshV8zSPNUhEefXe8I2QXE5ZODlIkDNkxyOzsIoSVyhsV2jiXnadqNnjlETKmqoRdIrbYaWDy1dL+yp5gyh/iJ/loGovN2CTEaSUBqT3ttndE9NL7sAmIt8PP041Vvog=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:03:49.652301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:03:49.652895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:03:49.653511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:03:49.654379 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:03:49.655430 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:03:49.711670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:49.714583 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:49.716936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:49.725887 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:49.749198 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-7bc26e8b-c76c-4ef3-a46f-498b5c9ba664 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Getting quotas for project 4fadf5b15f7e43b4bd2372f22b293518. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:03:49.764567 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-7bc26e8b-c76c-4ef3-a46f-498b5c9ba664 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Getting quotas for user 1501eb69e0a447ce83baa5bdee770d1f and project 4fadf5b15f7e43b4bd2372f22b293518. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:03:49.846479 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Getting quotas for project 7de2b98bf8c340d0b7646468c3594a47. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:03:49.864996 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7bc26e8b-c76c-4ef3-a46f-498b5c9ba664 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.698290 Jul 04 08:03:49.878732 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 14/23] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Jul 4 08:03:49 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 713 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 08:03:49.886435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Getting quotas for user 31fe6ac873124636977d593ad5dc2b65 and project 7de2b98bf8c340d0b7646468c3594a47. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:03:49.931914 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:03:49.935414 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1166069228", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e86146d1-c8e4-49f2-af91-e63989951c39"}], "security_groups": [{"name": "tempest-securitygroup--1133835151"}], "key_name": "tempest-keypair-1498478526", "user_data": "}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:03:49.949428 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:03:50.210660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-853c4e93-abda-4fd8-985d-4c92d19bdcd1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.387403 Jul 04 08:03:50.224619 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 10/24] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:03:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 4402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:03:50.240420 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9f5e64cc-0ccb-4bef-8376-35a271edc297 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:50.241501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9f5e64cc-0ccb-4bef-8376-35a271edc297 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:50.668535 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] validate_networks() for [('e86146d1-c8e4-49f2-af91-e63989951c39', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:03:50.856777 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9f5e64cc-0ccb-4bef-8376-35a271edc297 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:51.005923 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9f5e64cc-0ccb-4bef-8376-35a271edc297 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1214 microversion: 2.1 time: 0.773177 Jul 04 08:03:51.007051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 11/25] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:50 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1214 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:51.071198 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-454247854", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "094c34d1-ba24-4fc3-9ee2-cebe30c3a997"}], "security_groups": [{"name": "tempest-securitygroup--422995835"}], "key_name": "tempest-keypair-764593724", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:03:51.529017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] validate_networks() for [('094c34d1-ba24-4fc3-9ee2-cebe30c3a997', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:03:53.061460 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:03:53.062702 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:03:53.063434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:03:53.064060 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:03:53.064705 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:03:53.111429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:53.113866 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:53.119864 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:53.122254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:53.197145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Getting quotas for project 34a4b394ba684ed2a67d14b4a5b24f2f. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:03:53.215783 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Getting quotas for user 18b1072539af49729dff7ee9ea445c77 and project 34a4b394ba684ed2a67d14b4a5b24f2f. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:03:53.279140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:03:53.281684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:03:53.429917 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9cc61a62-efcd-4d72-9f7c-92dd515adc22 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.390448 Jul 04 08:03:53.432315 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 12/26] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:03:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:03:53.445617 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-67430fa9-9633-45c5-b594-67c4d1fce7d8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:53.452072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-67430fa9-9633-45c5-b594-67c4d1fce7d8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:53.860168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:03:53.861048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:03:53.861689 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:03:53.862361 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:03:53.862874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:03:53.887623 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:53.888351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:53.889435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:53.892076 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:53.913499 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67430fa9-9633-45c5-b594-67c4d1fce7d8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:53.951073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-67430fa9-9633-45c5-b594-67c4d1fce7d8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1214 microversion: 2.1 time: 0.517538 Jul 04 08:03:53.958521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:53 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1214 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:53.982618 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a53d7b16-8d6f-4c00-a1d1-f8014c0a436a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:53.986185 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a53d7b16-8d6f-4c00-a1d1-f8014c0a436a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:54.066697 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for project de5226d001fb47b399172b6633fec844. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:03:54.089476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for user 126ba607541e4c4895b47b4b7602ce01 and project de5226d001fb47b399172b6633fec844. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:03:54.141769 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:03:54.148467 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:03:54.251264 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a53d7b16-8d6f-4c00-a1d1-f8014c0a436a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:54.286193 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a53d7b16-8d6f-4c00-a1d1-f8014c0a436a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1236 microversion: 2.1 time: 0.322714 Jul 04 08:03:54.287980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-857a67d0-1051-405c-bed0-3c8e6e8008c3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.396952 Jul 04 08:03:54.296248 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 15/28] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:03:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 4416 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:03:54.304163 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 14/29] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:53 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1236 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:54.312915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ff06cf33-7921-4c48-a33a-5f32ad6a814d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:54.315573 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ff06cf33-7921-4c48-a33a-5f32ad6a814d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:54.524722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ff06cf33-7921-4c48-a33a-5f32ad6a814d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:54.587710 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ff06cf33-7921-4c48-a33a-5f32ad6a814d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1242 microversion: 2.1 time: 0.289950 Jul 04 08:03:54.589262 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 16/30] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:54 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1242 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:54.989711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6909b555-a7d0-4d62-a06b-ec84e5fdbc5e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:54.993371 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6909b555-a7d0-4d62-a06b-ec84e5fdbc5e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:55.066959 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6909b555-a7d0-4d62-a06b-ec84e5fdbc5e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:55.067812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6909b555-a7d0-4d62-a06b-ec84e5fdbc5e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:55.075598 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6909b555-a7d0-4d62-a06b-ec84e5fdbc5e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:55.076342 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6909b555-a7d0-4d62-a06b-ec84e5fdbc5e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:55.308801 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0e84ad5b-f508-4902-bd94-91ca2076cdc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:55.310065 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0e84ad5b-f508-4902-bd94-91ca2076cdc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:55.743231 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0e84ad5b-f508-4902-bd94-91ca2076cdc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:55.792405 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6909b555-a7d0-4d62-a06b-ec84e5fdbc5e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:55.793396 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0e84ad5b-f508-4902-bd94-91ca2076cdc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1236 microversion: 2.1 time: 0.491140 Jul 04 08:03:55.804488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 17/31] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:55 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1236 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:03:55.847881 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-060d1ba5-9572-434a-bbf1-b59e25a3da3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:55.848640 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6909b555-a7d0-4d62-a06b-ec84e5fdbc5e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1210 microversion: 2.1 time: 0.873124 Jul 04 08:03:55.853649 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 15/32] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:54 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1210 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:55.865803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-060d1ba5-9572-434a-bbf1-b59e25a3da3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:55.904632 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-060d1ba5-9572-434a-bbf1-b59e25a3da3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:55.906962 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-060d1ba5-9572-434a-bbf1-b59e25a3da3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:55.910813 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-060d1ba5-9572-434a-bbf1-b59e25a3da3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:55.917449 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-060d1ba5-9572-434a-bbf1-b59e25a3da3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:56.599154 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-784229304", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f1acad1-aa32-4b52-8575-cc350ac779f3"}], "security_groups": [{"name": "tempest-securitygroup--1470701673"}], "key_name": "tempest-keypair-1080070208", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:03:56.662206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-060d1ba5-9572-434a-bbf1-b59e25a3da3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:56.729799 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-060d1ba5-9572-434a-bbf1-b59e25a3da3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1246 microversion: 2.1 time: 0.916641 Jul 04 08:03:56.735819 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 18/33] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:55 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1246 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:56.816393 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ae5acbf7-d6ee-4fc5-8a89-48a6a1a38f66 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:56.818207 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ae5acbf7-d6ee-4fc5-8a89-48a6a1a38f66 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:56.856509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ae5acbf7-d6ee-4fc5-8a89-48a6a1a38f66 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:56.857022 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ae5acbf7-d6ee-4fc5-8a89-48a6a1a38f66 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:56.865466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ae5acbf7-d6ee-4fc5-8a89-48a6a1a38f66 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:56.873784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ae5acbf7-d6ee-4fc5-8a89-48a6a1a38f66 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:57.191230 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] validate_networks() for [('6f1acad1-aa32-4b52-8575-cc350ac779f3', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:03:57.418525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ae5acbf7-d6ee-4fc5-8a89-48a6a1a38f66 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:57.434073 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ae5acbf7-d6ee-4fc5-8a89-48a6a1a38f66 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1232 microversion: 2.1 time: 0.625243 Jul 04 08:03:57.462669 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 19/34] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:56 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1232 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:57.498946 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-197501cc-ff84-4d4b-a6ec-f83f16a1e0bb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:57.506831 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-197501cc-ff84-4d4b-a6ec-f83f16a1e0bb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:57.548592 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-197501cc-ff84-4d4b-a6ec-f83f16a1e0bb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:57.553369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-197501cc-ff84-4d4b-a6ec-f83f16a1e0bb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:57.558788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-197501cc-ff84-4d4b-a6ec-f83f16a1e0bb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:57.559605 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-197501cc-ff84-4d4b-a6ec-f83f16a1e0bb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:57.793507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-197501cc-ff84-4d4b-a6ec-f83f16a1e0bb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:57.814077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-197501cc-ff84-4d4b-a6ec-f83f16a1e0bb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1284 microversion: 2.1 time: 0.349504 Jul 04 08:03:57.815437 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 20/35] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:57 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1284 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:57.830739 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a1ee5196-6065-4cf8-a11f-207db6f147fb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:57.832222 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a1ee5196-6065-4cf8-a11f-207db6f147fb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:57.841751 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1ee5196-6065-4cf8-a11f-207db6f147fb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:57.842604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1ee5196-6065-4cf8-a11f-207db6f147fb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:57.844562 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1ee5196-6065-4cf8-a11f-207db6f147fb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:57.845329 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1ee5196-6065-4cf8-a11f-207db6f147fb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:58.031002 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a1ee5196-6065-4cf8-a11f-207db6f147fb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:58.057920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a1ee5196-6065-4cf8-a11f-207db6f147fb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1294 microversion: 2.1 time: 0.238700 Jul 04 08:03:58.061427 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 21/36] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:57 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1294 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:58.488837 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-50aeacd7-3311-4aca-89e3-04fe4ae2e90d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:58.490076 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-50aeacd7-3311-4aca-89e3-04fe4ae2e90d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:58.514681 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-50aeacd7-3311-4aca-89e3-04fe4ae2e90d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:58.515171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-50aeacd7-3311-4aca-89e3-04fe4ae2e90d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:58.517613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-50aeacd7-3311-4aca-89e3-04fe4ae2e90d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:58.518091 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-50aeacd7-3311-4aca-89e3-04fe4ae2e90d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:59.225374 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-50aeacd7-3311-4aca-89e3-04fe4ae2e90d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:59.237608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-50aeacd7-3311-4aca-89e3-04fe4ae2e90d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1294 microversion: 2.1 time: 0.755916 Jul 04 08:03:59.249673 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 22/37] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:58 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1294 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:59.250045 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:03:59.250045 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:03:59.250045 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:03:59.250623 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:03:59.251177 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:03:59.253502 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-28688c9c-bee6-4221-9b56-2e4a08ce86e9 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:59.254564 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-28688c9c-bee6-4221-9b56-2e4a08ce86e9 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:59.268155 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-28688c9c-bee6-4221-9b56-2e4a08ce86e9 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:59.271891 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-28688c9c-bee6-4221-9b56-2e4a08ce86e9 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:59.272993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-28688c9c-bee6-4221-9b56-2e4a08ce86e9 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:59.273519 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-28688c9c-bee6-4221-9b56-2e4a08ce86e9 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:59.293999 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:59.295838 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:59.301993 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:59.306566 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:59.366491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Getting quotas for project 4fadf5b15f7e43b4bd2372f22b293518. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:03:59.378489 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Getting quotas for user 1501eb69e0a447ce83baa5bdee770d1f and project 4fadf5b15f7e43b4bd2372f22b293518. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:03:59.402795 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:03:59.410019 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:03:59.423134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-28688c9c-bee6-4221-9b56-2e4a08ce86e9 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:59.436921 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-28688c9c-bee6-4221-9b56-2e4a08ce86e9 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1272 microversion: 2.1 time: 0.191998 Jul 04 08:03:59.438762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 23/38] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:59 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:03:59.453875 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-773f4e64-d763-4c54-a54e-2c9422cdd71b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:59.456273 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-773f4e64-d763-4c54-a54e-2c9422cdd71b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:59.479063 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-773f4e64-d763-4c54-a54e-2c9422cdd71b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:59.479772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-773f4e64-d763-4c54-a54e-2c9422cdd71b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:59.480837 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-773f4e64-d763-4c54-a54e-2c9422cdd71b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:03:59.481812 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-773f4e64-d763-4c54-a54e-2c9422cdd71b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:03:59.542694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9219148e-1b2a-4ad8-a3f1-e6387dceeab9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.953759 Jul 04 08:03:59.557881 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 16/39] 10.222.0.43 () {62 vars in 1187 bytes} [Mon Jul 4 08:03:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2970 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 08:03:59.574483 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-214a82dc-9f3e-4ced-8e04-258bc49bd14e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:03:59.578689 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-214a82dc-9f3e-4ced-8e04-258bc49bd14e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:03:59.684082 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-214a82dc-9f3e-4ced-8e04-258bc49bd14e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:59.696919 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-214a82dc-9f3e-4ced-8e04-258bc49bd14e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:59.699444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-214a82dc-9f3e-4ced-8e04-258bc49bd14e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:59.702157 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-214a82dc-9f3e-4ced-8e04-258bc49bd14e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1281 microversion: 2.20 time: 0.139888 Jul 04 08:03:59.703417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 17/40] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:03:59 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1281 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:03:59.860265 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-773f4e64-d763-4c54-a54e-2c9422cdd71b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:03:59.894668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-773f4e64-d763-4c54-a54e-2c9422cdd71b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1312 microversion: 2.1 time: 0.453313 Jul 04 08:03:59.907327 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 24/41] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:03:59 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1312 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:00.259130 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-239b0165-f92d-4f7f-8562-1e59a25525ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:00.260074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-239b0165-f92d-4f7f-8562-1e59a25525ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:00.276269 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-239b0165-f92d-4f7f-8562-1e59a25525ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:00.276738 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-239b0165-f92d-4f7f-8562-1e59a25525ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:00.277571 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-239b0165-f92d-4f7f-8562-1e59a25525ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:00.294791 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-239b0165-f92d-4f7f-8562-1e59a25525ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:00.458134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-54cb0014-6184-4548-a21b-af7c368a2c8e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:00.458134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-54cb0014-6184-4548-a21b-af7c368a2c8e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:00.493299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54cb0014-6184-4548-a21b-af7c368a2c8e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:00.493790 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54cb0014-6184-4548-a21b-af7c368a2c8e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:00.496236 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54cb0014-6184-4548-a21b-af7c368a2c8e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:00.496694 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54cb0014-6184-4548-a21b-af7c368a2c8e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:00.600663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-239b0165-f92d-4f7f-8562-1e59a25525ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:00.611046 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-239b0165-f92d-4f7f-8562-1e59a25525ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1294 microversion: 2.1 time: 0.356458 Jul 04 08:04:00.612095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 18/42] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:00 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1294 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:00.702762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-54cb0014-6184-4548-a21b-af7c368a2c8e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:00.716722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-54cb0014-6184-4548-a21b-af7c368a2c8e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1272 microversion: 2.1 time: 0.263388 Jul 04 08:04:00.719964 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 25/43] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:00 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1272 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:00.724562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:00.725242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:00.743543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:00.751469 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:00.754007 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:00.754491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:00.920206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cfeb7065-842a-4028-92c9-aba250e5a7ac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:00.921214 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cfeb7065-842a-4028-92c9-aba250e5a7ac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:00.937092 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:00.938583 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cfeb7065-842a-4028-92c9-aba250e5a7ac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:00.940526 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cfeb7065-842a-4028-92c9-aba250e5a7ac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:00.945844 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cfeb7065-842a-4028-92c9-aba250e5a7ac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:00.948012 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cfeb7065-842a-4028-92c9-aba250e5a7ac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:00.953052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:00.954698 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:00.956365 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-50217cb2-bb95-46a9-b588-f05e2d7ae166 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1285 microversion: 2.20 time: 0.236912 Jul 04 08:04:00.978187 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 19/44] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:00 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:04:01.160734 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cfeb7065-842a-4028-92c9-aba250e5a7ac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:01.176696 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cfeb7065-842a-4028-92c9-aba250e5a7ac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1312 microversion: 2.1 time: 0.263576 Jul 04 08:04:01.179847 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 26/45] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:00 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1312 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:01.635505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e079b1fa-cb81-42ee-967e-8e32973b2365 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:01.636809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e079b1fa-cb81-42ee-967e-8e32973b2365 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:01.665196 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e079b1fa-cb81-42ee-967e-8e32973b2365 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:01.670605 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e079b1fa-cb81-42ee-967e-8e32973b2365 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:01.671745 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e079b1fa-cb81-42ee-967e-8e32973b2365 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:01.672375 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e079b1fa-cb81-42ee-967e-8e32973b2365 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:01.738815 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9e22a597-93a7-42e0-b060-e957b4d8d7b6 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:01.739623 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9e22a597-93a7-42e0-b060-e957b4d8d7b6 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:01.762812 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e22a597-93a7-42e0-b060-e957b4d8d7b6 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:01.763321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e22a597-93a7-42e0-b060-e957b4d8d7b6 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:01.764253 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e22a597-93a7-42e0-b060-e957b4d8d7b6 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:01.774490 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e22a597-93a7-42e0-b060-e957b4d8d7b6 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:02.087075 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e079b1fa-cb81-42ee-967e-8e32973b2365 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:02.105907 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e079b1fa-cb81-42ee-967e-8e32973b2365 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1294 microversion: 2.1 time: 0.477130 Jul 04 08:04:02.114979 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 20/46] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:01 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1294 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:02.120546 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:02.142841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:02.167379 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:02.170107 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:02.186301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:02.187924 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:02.346594 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:02.361529 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:02.363885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:02.371177 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d5779668-fcb2-45e2-911e-7741dcca75c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1333 microversion: 2.20 time: 0.252995 Jul 04 08:04:02.372238 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 21/47] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:02 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1333 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:02.386147 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b1a73950-88f0-423c-88d7-2de91d4e0869 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:02.387126 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b1a73950-88f0-423c-88d7-2de91d4e0869 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:02.409070 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1a73950-88f0-423c-88d7-2de91d4e0869 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:02.412040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1a73950-88f0-423c-88d7-2de91d4e0869 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:02.414675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1a73950-88f0-423c-88d7-2de91d4e0869 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:02.415359 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1a73950-88f0-423c-88d7-2de91d4e0869 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:02.601053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9e22a597-93a7-42e0-b060-e957b4d8d7b6 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:02.612998 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9e22a597-93a7-42e0-b060-e957b4d8d7b6 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.877711 Jul 04 08:04:02.616853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 27/48] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:01 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:02.845057 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b1a73950-88f0-423c-88d7-2de91d4e0869 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:02.855066 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b1a73950-88f0-423c-88d7-2de91d4e0869 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1300 microversion: 2.1 time: 0.481430 Jul 04 08:04:02.878114 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 22/49] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:02 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1300 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:03.133409 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c18d2ff7-1807-4a88-b72d-5447611e868d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:03.133863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c18d2ff7-1807-4a88-b72d-5447611e868d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:03.163088 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c18d2ff7-1807-4a88-b72d-5447611e868d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:03.163546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c18d2ff7-1807-4a88-b72d-5447611e868d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:03.164367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c18d2ff7-1807-4a88-b72d-5447611e868d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:03.164816 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c18d2ff7-1807-4a88-b72d-5447611e868d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:03.394113 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:03.394847 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:03.405601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:03.410732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:03.412183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:03.415564 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:03.549924 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c18d2ff7-1807-4a88-b72d-5447611e868d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:03.569165 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c18d2ff7-1807-4a88-b72d-5447611e868d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1294 microversion: 2.1 time: 0.440417 Jul 04 08:04:03.570559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 28/50] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:03 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1294 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:03.641245 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d00f48c5-3237-439c-a0dd-a72f6463eca4 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:03.642805 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d00f48c5-3237-439c-a0dd-a72f6463eca4 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:03.686571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=5 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:03.688827 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d00f48c5-3237-439c-a0dd-a72f6463eca4 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:03.692110 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d00f48c5-3237-439c-a0dd-a72f6463eca4 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:03.693714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d00f48c5-3237-439c-a0dd-a72f6463eca4 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:03.694448 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d00f48c5-3237-439c-a0dd-a72f6463eca4 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:04.005075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:04.231180 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:04.240286 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:04.243765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:04.243765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f5fe88ec-6fab-4536-8d5d-943ba9d3c08a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1351 microversion: 2.20 time: 0.853692 Jul 04 08:04:04.243765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 23/51] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:03 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1351 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:04.269586 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-daa38901-54b4-4020-9ee7-cc213bb2b11d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:04.278247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-daa38901-54b4-4020-9ee7-cc213bb2b11d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:04.301601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-daa38901-54b4-4020-9ee7-cc213bb2b11d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:04.310615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-daa38901-54b4-4020-9ee7-cc213bb2b11d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:04.311381 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-daa38901-54b4-4020-9ee7-cc213bb2b11d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:04.311835 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-daa38901-54b4-4020-9ee7-cc213bb2b11d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:05.352698 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-daa38901-54b4-4020-9ee7-cc213bb2b11d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:05.371403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-daa38901-54b4-4020-9ee7-cc213bb2b11d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 1.118571 Jul 04 08:04:05.374824 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 24/52] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:04 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:05.381298 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c88fe21a-a284-4b5d-8e82-1a2011ac6fc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:05.398385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c88fe21a-a284-4b5d-8e82-1a2011ac6fc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:05.420907 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c88fe21a-a284-4b5d-8e82-1a2011ac6fc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:05.437467 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c88fe21a-a284-4b5d-8e82-1a2011ac6fc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:05.440714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c88fe21a-a284-4b5d-8e82-1a2011ac6fc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:05.441690 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c88fe21a-a284-4b5d-8e82-1a2011ac6fc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:05.483480 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d00f48c5-3237-439c-a0dd-a72f6463eca4 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:05.497980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d00f48c5-3237-439c-a0dd-a72f6463eca4 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 1.860911 Jul 04 08:04:05.498603 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 29/53] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:03 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:05.521208 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:05.522715 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:05.540723 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:05.541488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:05.544729 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:05.555481 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:05.792170 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=18 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:06.911483 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c88fe21a-a284-4b5d-8e82-1a2011ac6fc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:06.951575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c88fe21a-a284-4b5d-8e82-1a2011ac6fc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 1.562707 Jul 04 08:04:06.958092 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 25/54] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:05 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:06.975533 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b680e950-9c26-4ff3-b80a-7f7d43c331a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:06.978877 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b680e950-9c26-4ff3-b80a-7f7d43c331a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:06.987425 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:07.030058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b680e950-9c26-4ff3-b80a-7f7d43c331a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:07.030667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b680e950-9c26-4ff3-b80a-7f7d43c331a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:07.031578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b680e950-9c26-4ff3-b80a-7f7d43c331a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:07.032036 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b680e950-9c26-4ff3-b80a-7f7d43c331a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:07.407941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:07.443063 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:07.457602 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:07.459185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8d123ae7-e1a6-4271-9e1a-4ba5f3ec5ba9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1339 microversion: 2.20 time: 1.959066 Jul 04 08:04:07.460430 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 30/55] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:05 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1339 bytes in 1961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:07.481653 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cd113b70-91cb-496f-87ff-e7cb0f92d36f tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:07.488122 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cd113b70-91cb-496f-87ff-e7cb0f92d36f tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:07.517592 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd113b70-91cb-496f-87ff-e7cb0f92d36f tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:07.522916 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd113b70-91cb-496f-87ff-e7cb0f92d36f tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:07.525399 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd113b70-91cb-496f-87ff-e7cb0f92d36f tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:07.528346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cd113b70-91cb-496f-87ff-e7cb0f92d36f tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:08.368103 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cd113b70-91cb-496f-87ff-e7cb0f92d36f tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:08.378173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cd113b70-91cb-496f-87ff-e7cb0f92d36f tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.913640 Jul 04 08:04:08.383886 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 31/56] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:07 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:08.396560 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e69c4638-b197-4dc8-a695-151aa0d77e45 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:08.400300 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e69c4638-b197-4dc8-a695-151aa0d77e45 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:08.419757 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e69c4638-b197-4dc8-a695-151aa0d77e45 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:08.421232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e69c4638-b197-4dc8-a695-151aa0d77e45 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:08.422401 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e69c4638-b197-4dc8-a695-151aa0d77e45 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:08.427509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e69c4638-b197-4dc8-a695-151aa0d77e45 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:08.966039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b680e950-9c26-4ff3-b80a-7f7d43c331a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:09.010095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b680e950-9c26-4ff3-b80a-7f7d43c331a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 2.048094 Jul 04 08:04:09.013615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 26/57] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:06 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 2054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:09.036951 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:09.040487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:09.069460 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:09.071412 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:09.077646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:09.081155 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:09.348398 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:09.564777 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e69c4638-b197-4dc8-a695-151aa0d77e45 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:09.602801 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e69c4638-b197-4dc8-a695-151aa0d77e45 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 1.216107 Jul 04 08:04:09.623161 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 32/58] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:08 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:09.640276 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9af6dee0-9be2-41e0-8051-afce985a25fc tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:09.645945 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9af6dee0-9be2-41e0-8051-afce985a25fc tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:09.666665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9af6dee0-9be2-41e0-8051-afce985a25fc tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:09.667505 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9af6dee0-9be2-41e0-8051-afce985a25fc tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:09.668818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9af6dee0-9be2-41e0-8051-afce985a25fc tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:09.671695 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9af6dee0-9be2-41e0-8051-afce985a25fc tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:09.690914 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=30 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:09.891902 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:09.914099 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:09.924570 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:09.930483 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e7baafae-6483-469f-baa8-49e77a909b6a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1339 microversion: 2.20 time: 0.910923 Jul 04 08:04:09.936556 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 27/59] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:09 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1339 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:10.033603 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-be4ed560-abda-4146-8762-30a04a30a6f9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:10.034769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-be4ed560-abda-4146-8762-30a04a30a6f9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:10.054207 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be4ed560-abda-4146-8762-30a04a30a6f9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:10.054670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be4ed560-abda-4146-8762-30a04a30a6f9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:10.055546 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be4ed560-abda-4146-8762-30a04a30a6f9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:10.056030 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be4ed560-abda-4146-8762-30a04a30a6f9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:10.133364 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9af6dee0-9be2-41e0-8051-afce985a25fc tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:10.151117 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9af6dee0-9be2-41e0-8051-afce985a25fc tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.526610 Jul 04 08:04:10.166816 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 33/60] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:09 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:10.625123 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-89c00a2a-7e18-4442-b293-180a360ac708 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:10.630455 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-89c00a2a-7e18-4442-b293-180a360ac708 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:10.670001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89c00a2a-7e18-4442-b293-180a360ac708 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:10.671546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89c00a2a-7e18-4442-b293-180a360ac708 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:10.674040 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89c00a2a-7e18-4442-b293-180a360ac708 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:10.677411 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89c00a2a-7e18-4442-b293-180a360ac708 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:10.692768 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:11.182513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-be4ed560-abda-4146-8762-30a04a30a6f9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:11.203803 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=77 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:11.212162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-be4ed560-abda-4146-8762-30a04a30a6f9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 1.184554 Jul 04 08:04:11.214663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 28/61] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:10 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:11.236001 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:11.237491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:11.256578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:11.257185 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:11.258429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:11.259062 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:11.602592 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-89c00a2a-7e18-4442-b293-180a360ac708 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:11.621522 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-89c00a2a-7e18-4442-b293-180a360ac708 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 1.004659 Jul 04 08:04:11.634636 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 34/62] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:10 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:11.651545 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-af92f15b-6ad6-4482-a9b8-07dd6fb5bff5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:11.654036 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-af92f15b-6ad6-4482-a9b8-07dd6fb5bff5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:11.688281 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af92f15b-6ad6-4482-a9b8-07dd6fb5bff5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:11.689441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af92f15b-6ad6-4482-a9b8-07dd6fb5bff5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:11.694047 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af92f15b-6ad6-4482-a9b8-07dd6fb5bff5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:11.694969 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af92f15b-6ad6-4482-a9b8-07dd6fb5bff5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:11.858771 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:11.877487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:11.884903 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:11.888919 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2faa1219-9e8b-415c-92d5-70e27af6f8c1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1339 microversion: 2.20 time: 0.671256 Jul 04 08:04:11.901963 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 29/63] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:11 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1339 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:12.231583 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7e0bec50-a3c0-400d-83b4-fded860e6061 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:12.232233 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7e0bec50-a3c0-400d-83b4-fded860e6061 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:12.246855 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e0bec50-a3c0-400d-83b4-fded860e6061 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:12.247304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e0bec50-a3c0-400d-83b4-fded860e6061 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:12.248088 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e0bec50-a3c0-400d-83b4-fded860e6061 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:12.248518 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e0bec50-a3c0-400d-83b4-fded860e6061 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:13.860660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7e0bec50-a3c0-400d-83b4-fded860e6061 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:13.873287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7e0bec50-a3c0-400d-83b4-fded860e6061 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 1.645499 Jul 04 08:04:13.886672 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 30/64] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:12 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:13.892356 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6fa00a25-a335-43ef-bc5c-68b0fc2b3e8c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:13.905372 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6fa00a25-a335-43ef-bc5c-68b0fc2b3e8c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:13.918592 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6fa00a25-a335-43ef-bc5c-68b0fc2b3e8c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:13.923886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6fa00a25-a335-43ef-bc5c-68b0fc2b3e8c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:13.925063 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6fa00a25-a335-43ef-bc5c-68b0fc2b3e8c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:13.927941 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6fa00a25-a335-43ef-bc5c-68b0fc2b3e8c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:14.208754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-af92f15b-6ad6-4482-a9b8-07dd6fb5bff5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:14.236730 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-af92f15b-6ad6-4482-a9b8-07dd6fb5bff5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 2.596108 Jul 04 08:04:14.237339 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 35/65] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:11 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 2601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:14.255034 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:14.255650 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:14.274821 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:14.275650 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:14.276785 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:14.277435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:14.969134 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6fa00a25-a335-43ef-bc5c-68b0fc2b3e8c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:14.980589 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6fa00a25-a335-43ef-bc5c-68b0fc2b3e8c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 1.092309 Jul 04 08:04:14.985430 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 31/66] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:13 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:15.704126 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:15.720046 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:15.725866 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:15.746129 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-85cd2f92-7239-49d7-84b1-38e549fb7e4f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 1.506755 Jul 04 08:04:15.748516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 36/67] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:14 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:15.819535 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-71f3bda1-d0b0-4955-971a-7502b775c2bd req-af46f2ff-47bb-4bd5-b789-b8fd283ac0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd9e555-ba83-4ef3-b775-12ea3083901b", "tag": "b25ad08a-5d11-4942-8c91-fbb1ec88fba2"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:15.856561 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-71f3bda1-d0b0-4955-971a-7502b775c2bd req-af46f2ff-47bb-4bd5-b789-b8fd283ac0f7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:15.858357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-71f3bda1-d0b0-4955-971a-7502b775c2bd req-af46f2ff-47bb-4bd5-b789-b8fd283ac0f7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:15.903679 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-71f3bda1-d0b0-4955-971a-7502b775c2bd req-af46f2ff-47bb-4bd5-b789-b8fd283ac0f7 service nova] Creating event network-changed:b25ad08a-5d11-4942-8c91-fbb1ec88fba2 for instance 1cd9e555-ba83-4ef3-b775-12ea3083901b on hv-cinder-79760 Jul 04 08:04:15.904225 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-71f3bda1-d0b0-4955-971a-7502b775c2bd req-af46f2ff-47bb-4bd5-b789-b8fd283ac0f7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 08:04:15.905412 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66fe729a-f143-476b-ab7f-755258c08f2e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:15.910115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66fe729a-f143-476b-ab7f-755258c08f2e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:15.911301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66fe729a-f143-476b-ab7f-755258c08f2e None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:15.911784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66fe729a-f143-476b-ab7f-755258c08f2e None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:15.945841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.compute.rpcapi [None req-66fe729a-f143-476b-ab7f-755258c08f2e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 08:04:15.947036 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66fe729a-f143-476b-ab7f-755258c08f2e None None] Releasing lock "compute-rpcapi-router" {{(pid=117871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 08:04:15.991708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-66fe729a-f143-476b-ab7f-755258c08f2e None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.004359 Jul 04 08:04:15.993139 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 32/68] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:16.007273 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3ab7eba2-c110-46ef-9f83-a46c050f2d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:16.010445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3ab7eba2-c110-46ef-9f83-a46c050f2d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:16.039162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3ab7eba2-c110-46ef-9f83-a46c050f2d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:16.040166 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3ab7eba2-c110-46ef-9f83-a46c050f2d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:16.042844 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3ab7eba2-c110-46ef-9f83-a46c050f2d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:16.044115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3ab7eba2-c110-46ef-9f83-a46c050f2d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:16.230134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-90cf1397-ed57-4d05-8f95-d1effd6db549 req-df33db4e-50d3-406c-b8fc-906c8c6b9cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b415c8c-45f0-4469-82d4-a3b8c3c6145f", "tag": "84fb4212-970a-48e7-a1ab-238bd3c64f6a"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:16.288307 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-90cf1397-ed57-4d05-8f95-d1effd6db549 req-df33db4e-50d3-406c-b8fc-906c8c6b9cc3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:16.289025 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-90cf1397-ed57-4d05-8f95-d1effd6db549 req-df33db4e-50d3-406c-b8fc-906c8c6b9cc3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:16.397481 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-90cf1397-ed57-4d05-8f95-d1effd6db549 req-df33db4e-50d3-406c-b8fc-906c8c6b9cc3 service nova] Creating event network-changed:84fb4212-970a-48e7-a1ab-238bd3c64f6a for instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f on hv-cinder-79760 Jul 04 08:04:16.399102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-90cf1397-ed57-4d05-8f95-d1effd6db549 req-df33db4e-50d3-406c-b8fc-906c8c6b9cc3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 04 08:04:16.401951 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fee0e8f1-1a4d-4081-863e-772038201d99 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:16.403132 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fee0e8f1-1a4d-4081-863e-772038201d99 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:16.406685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fee0e8f1-1a4d-4081-863e-772038201d99 None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:16.407731 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fee0e8f1-1a4d-4081-863e-772038201d99 None None] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:16.448794 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.compute.rpcapi [None req-fee0e8f1-1a4d-4081-863e-772038201d99 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 04 08:04:16.451774 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fee0e8f1-1a4d-4081-863e-772038201d99 None None] Releasing lock "compute-rpcapi-router" {{(pid=117870) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 04 08:04:16.511187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fee0e8f1-1a4d-4081-863e-772038201d99 None None] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.757156 Jul 04 08:04:16.512154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 37/69] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:16.512971 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3ab7eba2-c110-46ef-9f83-a46c050f2d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:16.523431 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9039dcc7-6566-4905-844b-017b52cc8456 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:16.524186 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9039dcc7-6566-4905-844b-017b52cc8456 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:16.540199 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9039dcc7-6566-4905-844b-017b52cc8456 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:16.541081 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9039dcc7-6566-4905-844b-017b52cc8456 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:16.542184 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9039dcc7-6566-4905-844b-017b52cc8456 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:16.543508 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9039dcc7-6566-4905-844b-017b52cc8456 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:16.556900 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3ab7eba2-c110-46ef-9f83-a46c050f2d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.561884 Jul 04 08:04:16.569707 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 33/70] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:15 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:16.585102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5a8efb76-f9cd-41eb-a611-5f3f8df52e94 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:16.586309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5a8efb76-f9cd-41eb-a611-5f3f8df52e94 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:16.598924 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a8efb76-f9cd-41eb-a611-5f3f8df52e94 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:16.599724 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a8efb76-f9cd-41eb-a611-5f3f8df52e94 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:16.601230 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a8efb76-f9cd-41eb-a611-5f3f8df52e94 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:16.602336 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a8efb76-f9cd-41eb-a611-5f3f8df52e94 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:17.294120 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5a8efb76-f9cd-41eb-a611-5f3f8df52e94 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:17.305378 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5a8efb76-f9cd-41eb-a611-5f3f8df52e94 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.731744 Jul 04 08:04:17.308171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 34/71] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:16 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:17.323871 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:17.326812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:17.364369 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:17.367906 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:17.369153 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:17.370147 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:17.620582 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:17.640880 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:17.643352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:17.645356 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fb0ccd40-b1d1-4451-934f-de2596a84c79 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.335593 Jul 04 08:04:17.646398 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 35/72] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:17 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:17.653423 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-009237b4-b04a-4765-956d-6b9d346195b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:17.654301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-009237b4-b04a-4765-956d-6b9d346195b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:17.664389 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-009237b4-b04a-4765-956d-6b9d346195b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:17.665971 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-009237b4-b04a-4765-956d-6b9d346195b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:17.668535 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-009237b4-b04a-4765-956d-6b9d346195b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:17.669489 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-009237b4-b04a-4765-956d-6b9d346195b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:17.745066 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9039dcc7-6566-4905-844b-017b52cc8456 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:17.776383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9039dcc7-6566-4905-844b-017b52cc8456 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 1.260839 Jul 04 08:04:17.777754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 38/73] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:16 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:17.974167 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-009237b4-b04a-4765-956d-6b9d346195b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:17.990870 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-009237b4-b04a-4765-956d-6b9d346195b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.341912 Jul 04 08:04:17.993000 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 36/74] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:17 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:18.350222 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-596101b0-9ed1-4c7b-b7c8-00f51b70cd99 req-65441e36-3258-4068-b43c-f92b2769e644 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce6703a-43b5-47a0-8d17-1794e718e3b1", "tag": "525c4cce-65e1-4ea7-8d82-0a5a7a69ede9"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:18.351524 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-307f4155-90e9-4e37-8f60-84d66116b384 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:18.358330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-307f4155-90e9-4e37-8f60-84d66116b384 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:18.375094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-596101b0-9ed1-4c7b-b7c8-00f51b70cd99 req-65441e36-3258-4068-b43c-f92b2769e644 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:18.375638 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-307f4155-90e9-4e37-8f60-84d66116b384 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:18.375858 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-596101b0-9ed1-4c7b-b7c8-00f51b70cd99 req-65441e36-3258-4068-b43c-f92b2769e644 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:18.378292 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-307f4155-90e9-4e37-8f60-84d66116b384 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:18.381290 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-307f4155-90e9-4e37-8f60-84d66116b384 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:18.381778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-307f4155-90e9-4e37-8f60-84d66116b384 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:18.405247 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-596101b0-9ed1-4c7b-b7c8-00f51b70cd99 req-65441e36-3258-4068-b43c-f92b2769e644 service nova] Creating event network-changed:525c4cce-65e1-4ea7-8d82-0a5a7a69ede9 for instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 on hv-cinder-79760 Jul 04 08:04:18.434053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-596101b0-9ed1-4c7b-b7c8-00f51b70cd99 req-65441e36-3258-4068-b43c-f92b2769e644 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103740 Jul 04 08:04:18.443244 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 39/75] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:18.666442 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:18.667495 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:18.677398 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:18.678299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:18.680631 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:18.682270 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:18.737988 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-307f4155-90e9-4e37-8f60-84d66116b384 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:18.759471 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-307f4155-90e9-4e37-8f60-84d66116b384 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.427911 Jul 04 08:04:18.775572 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 37/76] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:18 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:18.806537 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-12487c7c-2e62-4ad0-9bc4-020516dbeac5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:18.808536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-12487c7c-2e62-4ad0-9bc4-020516dbeac5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:18.832792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-12487c7c-2e62-4ad0-9bc4-020516dbeac5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:18.836026 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-12487c7c-2e62-4ad0-9bc4-020516dbeac5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:18.839339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-12487c7c-2e62-4ad0-9bc4-020516dbeac5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:18.839822 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-12487c7c-2e62-4ad0-9bc4-020516dbeac5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:19.104482 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:19.115028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:19.116635 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:19.118147 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-72654e21-821a-4822-b8b9-457b9c9f224d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.457405 Jul 04 08:04:19.122543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-12487c7c-2e62-4ad0-9bc4-020516dbeac5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:19.130178 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 40/77] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:18 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:04:19.136024 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5b11a874-3d34-4807-8344-de195bc280e5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:19.136630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5b11a874-3d34-4807-8344-de195bc280e5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:19.143698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b11a874-3d34-4807-8344-de195bc280e5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:19.144810 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b11a874-3d34-4807-8344-de195bc280e5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:19.145903 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b11a874-3d34-4807-8344-de195bc280e5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:19.146526 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b11a874-3d34-4807-8344-de195bc280e5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:19.149777 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-12487c7c-2e62-4ad0-9bc4-020516dbeac5 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.357170 Jul 04 08:04:19.156055 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 38/78] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:18 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:19.395811 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5b11a874-3d34-4807-8344-de195bc280e5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:19.409028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5b11a874-3d34-4807-8344-de195bc280e5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.277210 Jul 04 08:04:19.410999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 41/79] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:19 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:19.792646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c9be8983-7983-4bc8-9f3f-1dbf082fdf02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:19.792646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c9be8983-7983-4bc8-9f3f-1dbf082fdf02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:19.796072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9be8983-7983-4bc8-9f3f-1dbf082fdf02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:19.796528 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9be8983-7983-4bc8-9f3f-1dbf082fdf02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:19.797531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9be8983-7983-4bc8-9f3f-1dbf082fdf02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:19.797829 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9be8983-7983-4bc8-9f3f-1dbf082fdf02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:20.001667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c9be8983-7983-4bc8-9f3f-1dbf082fdf02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:20.011138 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c9be8983-7983-4bc8-9f3f-1dbf082fdf02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.226577 Jul 04 08:04:20.021480 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 39/80] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:19 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:20.136924 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:20.137525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:20.144365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:20.145580 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:20.146410 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:20.147073 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:20.177137 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9764b64b-465a-487c-8f2e-2adde3b23bea tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:20.178185 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9764b64b-465a-487c-8f2e-2adde3b23bea tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:20.193998 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9764b64b-465a-487c-8f2e-2adde3b23bea tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:20.195099 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9764b64b-465a-487c-8f2e-2adde3b23bea tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:20.196240 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9764b64b-465a-487c-8f2e-2adde3b23bea tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:20.196686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9764b64b-465a-487c-8f2e-2adde3b23bea tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:20.384874 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9764b64b-465a-487c-8f2e-2adde3b23bea tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:20.397483 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9764b64b-465a-487c-8f2e-2adde3b23bea tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.226679 Jul 04 08:04:20.399179 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 40/81] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:20 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:20.417980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:20.434020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:20.437767 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:20.440104 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-21f7612e-59eb-409c-8063-72d40b31fcc8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:20.440467 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-31777d05-07cd-4b41-8b2e-381f4eb70fa4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.306957 Jul 04 08:04:20.441109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-21f7612e-59eb-409c-8063-72d40b31fcc8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:20.442027 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 42/82] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:20 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:20.450111 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-21f7612e-59eb-409c-8063-72d40b31fcc8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:20.450863 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-21f7612e-59eb-409c-8063-72d40b31fcc8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:20.452025 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-21f7612e-59eb-409c-8063-72d40b31fcc8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:20.452753 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-21f7612e-59eb-409c-8063-72d40b31fcc8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:20.645125 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-21f7612e-59eb-409c-8063-72d40b31fcc8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:20.653244 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-21f7612e-59eb-409c-8063-72d40b31fcc8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.218340 Jul 04 08:04:20.654237 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 41/83] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:20 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:20.703613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-0a5266ae-cd61-430e-9d06-630b36a5ec11 req-cc1db913-0a66-4adf-bb41-f1f322bd56ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42c331b-8c2a-4f37-bd0a-7221b07bf3af", "tag": "624f3113-8fef-448f-b1f3-28db878c297b"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:20.719635 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0a5266ae-cd61-430e-9d06-630b36a5ec11 req-cc1db913-0a66-4adf-bb41-f1f322bd56ed service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:20.720763 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0a5266ae-cd61-430e-9d06-630b36a5ec11 req-cc1db913-0a66-4adf-bb41-f1f322bd56ed service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:20.734996 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-0a5266ae-cd61-430e-9d06-630b36a5ec11 req-cc1db913-0a66-4adf-bb41-f1f322bd56ed service nova] Creating event network-changed:624f3113-8fef-448f-b1f3-28db878c297b for instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af on hv-cinder-79760 Jul 04 08:04:20.741740 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-0a5266ae-cd61-430e-9d06-630b36a5ec11 req-cc1db913-0a66-4adf-bb41-f1f322bd56ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043035 Jul 04 08:04:20.742369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 43/84] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:21.037095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-aaf02d28-dc36-4126-87de-e5b65030d1bd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:21.038317 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-aaf02d28-dc36-4126-87de-e5b65030d1bd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:21.047968 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aaf02d28-dc36-4126-87de-e5b65030d1bd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:21.048759 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aaf02d28-dc36-4126-87de-e5b65030d1bd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:21.050224 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aaf02d28-dc36-4126-87de-e5b65030d1bd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:21.051232 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aaf02d28-dc36-4126-87de-e5b65030d1bd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:21.398702 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aaf02d28-dc36-4126-87de-e5b65030d1bd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:21.417804 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-aaf02d28-dc36-4126-87de-e5b65030d1bd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.389667 Jul 04 08:04:21.418679 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 42/85] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:21 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:21.421405 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-770b8c0e-ac24-47ef-86e7-a2b54d187e08 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:21.422523 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-770b8c0e-ac24-47ef-86e7-a2b54d187e08 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:21.430002 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-770b8c0e-ac24-47ef-86e7-a2b54d187e08 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:21.431098 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-770b8c0e-ac24-47ef-86e7-a2b54d187e08 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:21.432573 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-770b8c0e-ac24-47ef-86e7-a2b54d187e08 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:21.433021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-770b8c0e-ac24-47ef-86e7-a2b54d187e08 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:21.475936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:21.477275 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:21.496996 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:21.498229 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:21.501494 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:21.503918 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:21.825973 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-770b8c0e-ac24-47ef-86e7-a2b54d187e08 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:21.848091 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:21.864437 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:21.868985 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:21.873685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-770b8c0e-ac24-47ef-86e7-a2b54d187e08 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.454396 Jul 04 08:04:21.874653 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 44/86] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:21 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:21.880291 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-321313e6-f4d7-4379-8bdf-b2e7293d1d2c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:21.881166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-321313e6-f4d7-4379-8bdf-b2e7293d1d2c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:21.889566 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-321313e6-f4d7-4379-8bdf-b2e7293d1d2c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:21.890331 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-321313e6-f4d7-4379-8bdf-b2e7293d1d2c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:21.891705 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-321313e6-f4d7-4379-8bdf-b2e7293d1d2c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:21.892546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-321313e6-f4d7-4379-8bdf-b2e7293d1d2c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:21.899247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-eb87bb75-775f-4e05-bd47-234439d87c0f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.434184 Jul 04 08:04:21.899920 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 43/87] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:21 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:22.170558 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-321313e6-f4d7-4379-8bdf-b2e7293d1d2c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:22.212028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-321313e6-f4d7-4379-8bdf-b2e7293d1d2c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.329412 Jul 04 08:04:22.213408 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 45/88] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:21 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:22.443681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8d135b46-a640-464a-bb9f-c35bf6d0f17d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:22.444794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8d135b46-a640-464a-bb9f-c35bf6d0f17d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:22.457955 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d135b46-a640-464a-bb9f-c35bf6d0f17d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:22.459219 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d135b46-a640-464a-bb9f-c35bf6d0f17d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:22.460370 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d135b46-a640-464a-bb9f-c35bf6d0f17d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:22.461069 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d135b46-a640-464a-bb9f-c35bf6d0f17d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:22.899089 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1cd18942-3c55-43e8-a111-c5b2f0cfa47a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:22.901124 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1cd18942-3c55-43e8-a111-c5b2f0cfa47a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:22.921768 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1cd18942-3c55-43e8-a111-c5b2f0cfa47a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:22.923090 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1cd18942-3c55-43e8-a111-c5b2f0cfa47a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:22.925161 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1cd18942-3c55-43e8-a111-c5b2f0cfa47a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:22.927419 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1cd18942-3c55-43e8-a111-c5b2f0cfa47a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:23.216711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8d135b46-a640-464a-bb9f-c35bf6d0f17d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:23.259172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8d135b46-a640-464a-bb9f-c35bf6d0f17d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.820264 Jul 04 08:04:23.260960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 44/89] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:22 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:23.270435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:23.271550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:23.299319 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:23.300083 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:23.301867 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:23.302659 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:23.661051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:23.665365 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:23.688736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:23.690478 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:23.691972 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b589b6f0-a5ee-499f-8048-2d887a900745 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.429085 Jul 04 08:04:23.693321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 45/90] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:23 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:23.699663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d242b125-55cb-4e52-a8a5-5abd29ad71cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:23.700619 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d242b125-55cb-4e52-a8a5-5abd29ad71cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:23.715240 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d242b125-55cb-4e52-a8a5-5abd29ad71cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:23.715999 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d242b125-55cb-4e52-a8a5-5abd29ad71cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:23.716966 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d242b125-55cb-4e52-a8a5-5abd29ad71cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:23.717550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d242b125-55cb-4e52-a8a5-5abd29ad71cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:24.022250 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1cd18942-3c55-43e8-a111-c5b2f0cfa47a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:24.032165 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1cd18942-3c55-43e8-a111-c5b2f0cfa47a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 1.140482 Jul 04 08:04:24.056813 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 46/91] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:22 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:24.102665 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d242b125-55cb-4e52-a8a5-5abd29ad71cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:24.112099 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d242b125-55cb-4e52-a8a5-5abd29ad71cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.417659 Jul 04 08:04:24.112889 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 46/92] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:23 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:24.280265 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ec0d1c77-b49a-4344-b9ce-572deeb13b6a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:24.281794 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ec0d1c77-b49a-4344-b9ce-572deeb13b6a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:24.297187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec0d1c77-b49a-4344-b9ce-572deeb13b6a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:24.303186 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec0d1c77-b49a-4344-b9ce-572deeb13b6a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:24.305405 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec0d1c77-b49a-4344-b9ce-572deeb13b6a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:24.306803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec0d1c77-b49a-4344-b9ce-572deeb13b6a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:24.532361 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ec0d1c77-b49a-4344-b9ce-572deeb13b6a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:24.542906 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ec0d1c77-b49a-4344-b9ce-572deeb13b6a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.267665 Jul 04 08:04:24.543846 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 47/93] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:24 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:24.718968 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:24.720197 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:24.731926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:24.732571 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:24.734191 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:24.735022 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:25.047887 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:25.067173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9d4681d8-47e4-44ce-a2e1-0b4bd69d0552 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:25.073711 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9d4681d8-47e4-44ce-a2e1-0b4bd69d0552 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:25.074265 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:25.078152 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:25.080575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-627bfa42-571b-4b0b-84a0-b2dc833eb698 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.368961 Jul 04 08:04:25.082452 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 47/94] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:24 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:25.107595 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9d4681d8-47e4-44ce-a2e1-0b4bd69d0552 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:25.107595 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9d4681d8-47e4-44ce-a2e1-0b4bd69d0552 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:25.107595 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9d4681d8-47e4-44ce-a2e1-0b4bd69d0552 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:25.108588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9d4681d8-47e4-44ce-a2e1-0b4bd69d0552 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:25.150549 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dec48493-9522-44be-86b4-50153b46d087 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:25.151940 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-dec48493-9522-44be-86b4-50153b46d087 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:25.177256 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dec48493-9522-44be-86b4-50153b46d087 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:25.178040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dec48493-9522-44be-86b4-50153b46d087 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:25.182301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dec48493-9522-44be-86b4-50153b46d087 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:25.183026 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dec48493-9522-44be-86b4-50153b46d087 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:25.635227 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dec48493-9522-44be-86b4-50153b46d087 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:25.667142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-dec48493-9522-44be-86b4-50153b46d087 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.535551 Jul 04 08:04:25.685243 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 48/95] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:25 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:25.696752 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-edad5311-82f2-4614-805e-bd00c31a1cdd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:25.698913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-edad5311-82f2-4614-805e-bd00c31a1cdd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:25.722123 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edad5311-82f2-4614-805e-bd00c31a1cdd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:25.724706 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edad5311-82f2-4614-805e-bd00c31a1cdd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:25.726526 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edad5311-82f2-4614-805e-bd00c31a1cdd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:25.727561 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edad5311-82f2-4614-805e-bd00c31a1cdd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:25.938014 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:26.074837 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9d4681d8-47e4-44ce-a2e1-0b4bd69d0552 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:26.086462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9d4681d8-47e4-44ce-a2e1-0b4bd69d0552 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 1.026110 Jul 04 08:04:26.087541 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 48/96] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:25 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:26.112998 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-edad5311-82f2-4614-805e-bd00c31a1cdd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:26.120490 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:26.122333 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:26.139151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-edad5311-82f2-4614-805e-bd00c31a1cdd tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.451796 Jul 04 08:04:26.150167 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:26.150990 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:26.152757 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 49/97] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:25 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:26.154625 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:26.155128 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:26.445318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:26.612752 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:26.633489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:26.636606 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:26.650053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-57c7cbc7-6ea7-4b66-9cd7-c29a1b64c7a8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.526525 Jul 04 08:04:26.650740 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 49/98] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:26 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:04:26.698031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-960edd31-c2dc-4261-9738-987e8eddba96 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:26.699046 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-960edd31-c2dc-4261-9738-987e8eddba96 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:26.714247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-960edd31-c2dc-4261-9738-987e8eddba96 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:26.715062 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-960edd31-c2dc-4261-9738-987e8eddba96 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:26.716118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-960edd31-c2dc-4261-9738-987e8eddba96 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:26.716951 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-960edd31-c2dc-4261-9738-987e8eddba96 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:27.060534 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-960edd31-c2dc-4261-9738-987e8eddba96 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:27.081503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-960edd31-c2dc-4261-9738-987e8eddba96 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.388552 Jul 04 08:04:27.096112 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 50/99] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:26 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:27.137753 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9b0b9eb9-a9ab-45cf-9d73-f599ad0eea0e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:27.138599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9b0b9eb9-a9ab-45cf-9d73-f599ad0eea0e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:27.147557 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9b0b9eb9-a9ab-45cf-9d73-f599ad0eea0e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:27.148116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9b0b9eb9-a9ab-45cf-9d73-f599ad0eea0e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:27.149012 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9b0b9eb9-a9ab-45cf-9d73-f599ad0eea0e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:27.149562 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9b0b9eb9-a9ab-45cf-9d73-f599ad0eea0e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:27.162302 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-20de6a17-d825-480a-9a58-36c88d4fed04 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:27.166112 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-20de6a17-d825-480a-9a58-36c88d4fed04 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:27.196568 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20de6a17-d825-480a-9a58-36c88d4fed04 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:27.202652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20de6a17-d825-480a-9a58-36c88d4fed04 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:27.204720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20de6a17-d825-480a-9a58-36c88d4fed04 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:27.205892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20de6a17-d825-480a-9a58-36c88d4fed04 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:27.619511 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9b0b9eb9-a9ab-45cf-9d73-f599ad0eea0e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:27.648035 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-20de6a17-d825-480a-9a58-36c88d4fed04 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:27.650400 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9b0b9eb9-a9ab-45cf-9d73-f599ad0eea0e tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.538229 Jul 04 08:04:27.651668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 50/100] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:27 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:27.685464 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:27.685464 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:27.686854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-20de6a17-d825-480a-9a58-36c88d4fed04 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.531285 Jul 04 08:04:27.696618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:27.697260 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:27.698274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:27.698831 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:27.702277 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 51/101] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:27 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:28.094082 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:28.109920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:28.131085 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-de84d5f6-ba9d-4d37-8934-4b039f998241 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:28.131825 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:28.134116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-990422b5-7a32-419f-9e30-d1f38458f07b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.460341 Jul 04 08:04:28.135888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-de84d5f6-ba9d-4d37-8934-4b039f998241 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:28.141517 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 51/102] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:27 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:28.168973 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de84d5f6-ba9d-4d37-8934-4b039f998241 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:28.170121 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de84d5f6-ba9d-4d37-8934-4b039f998241 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:28.172990 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de84d5f6-ba9d-4d37-8934-4b039f998241 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:28.173606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de84d5f6-ba9d-4d37-8934-4b039f998241 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:28.544913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-de84d5f6-ba9d-4d37-8934-4b039f998241 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:28.561052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-de84d5f6-ba9d-4d37-8934-4b039f998241 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.443211 Jul 04 08:04:28.562755 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 52/103] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:28 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:28.672529 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-2ba0a19a-c1ff-4a6b-beb0-69c1bc6485bb req-9fde2a20-0812-49cf-a886-50f69affdf9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b415c8c-45f0-4469-82d4-a3b8c3c6145f", "name": "network-vif-plugged", "status": "completed", "tag": "84fb4212-970a-48e7-a1ab-238bd3c64f6a"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:28.684272 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c2d10170-d403-4ff8-9aeb-e97d6d5ee5c8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:28.685144 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c2d10170-d403-4ff8-9aeb-e97d6d5ee5c8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:28.696679 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c2d10170-d403-4ff8-9aeb-e97d6d5ee5c8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:28.697447 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c2d10170-d403-4ff8-9aeb-e97d6d5ee5c8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:28.698308 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c2d10170-d403-4ff8-9aeb-e97d6d5ee5c8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:28.699509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-2ba0a19a-c1ff-4a6b-beb0-69c1bc6485bb req-9fde2a20-0812-49cf-a886-50f69affdf9b service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:28.699956 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-2ba0a19a-c1ff-4a6b-beb0-69c1bc6485bb req-9fde2a20-0812-49cf-a886-50f69affdf9b service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:28.702340 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c2d10170-d403-4ff8-9aeb-e97d6d5ee5c8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:28.751952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-2ba0a19a-c1ff-4a6b-beb0-69c1bc6485bb req-9fde2a20-0812-49cf-a886-50f69affdf9b service nova] Creating event network-vif-plugged:84fb4212-970a-48e7-a1ab-238bd3c64f6a for instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f on hv-cinder-79760 Jul 04 08:04:28.762333 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-2ba0a19a-c1ff-4a6b-beb0-69c1bc6485bb req-9fde2a20-0812-49cf-a886-50f69affdf9b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311785 Jul 04 08:04:28.762990 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 52/104] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:28.769534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6564300d-bc68-4e97-9044-c836bb97cd8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:28.770572 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6564300d-bc68-4e97-9044-c836bb97cd8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:28.777666 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6564300d-bc68-4e97-9044-c836bb97cd8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:28.778128 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6564300d-bc68-4e97-9044-c836bb97cd8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:28.779053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6564300d-bc68-4e97-9044-c836bb97cd8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:28.779672 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6564300d-bc68-4e97-9044-c836bb97cd8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:28.786121 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:28.985593 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6564300d-bc68-4e97-9044-c836bb97cd8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:28.996134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6564300d-bc68-4e97-9044-c836bb97cd8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.231597 Jul 04 08:04:28.996747 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 53/105] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:28 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:29.059568 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c2d10170-d403-4ff8-9aeb-e97d6d5ee5c8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:29.068821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c2d10170-d403-4ff8-9aeb-e97d6d5ee5c8 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.388531 Jul 04 08:04:29.069824 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 53/106] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:28 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:29.165666 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:29.166408 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:29.178586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:29.179454 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:29.180855 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:29.182013 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:29.442388 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:29.453985 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:29.458249 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:29.460537 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-125a7c70-8972-4c8f-a63d-5eae6a101d9e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.304296 Jul 04 08:04:29.461773 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 54/107] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:29 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:29.591879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9dea5b33-7fc9-442b-a3b8-5c613d918c3b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:29.592678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9dea5b33-7fc9-442b-a3b8-5c613d918c3b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:29.602755 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9dea5b33-7fc9-442b-a3b8-5c613d918c3b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:29.603208 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9dea5b33-7fc9-442b-a3b8-5c613d918c3b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:29.604015 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9dea5b33-7fc9-442b-a3b8-5c613d918c3b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:29.604449 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9dea5b33-7fc9-442b-a3b8-5c613d918c3b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:29.870888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9dea5b33-7fc9-442b-a3b8-5c613d918c3b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:29.886223 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9dea5b33-7fc9-442b-a3b8-5c613d918c3b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.298343 Jul 04 08:04:29.889184 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 54/108] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:29 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:30.026025 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e2b8e8af-9b6f-4428-b6d3-9d075e0459b5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:30.027597 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e2b8e8af-9b6f-4428-b6d3-9d075e0459b5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:30.058766 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2b8e8af-9b6f-4428-b6d3-9d075e0459b5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:30.059532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2b8e8af-9b6f-4428-b6d3-9d075e0459b5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:30.062037 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2b8e8af-9b6f-4428-b6d3-9d075e0459b5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:30.063165 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2b8e8af-9b6f-4428-b6d3-9d075e0459b5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:30.092660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-27d6786b-675a-45da-9127-0e37d1adb574 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:30.094946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-27d6786b-675a-45da-9127-0e37d1adb574 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:30.163080 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27d6786b-675a-45da-9127-0e37d1adb574 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:30.163442 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27d6786b-675a-45da-9127-0e37d1adb574 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:30.166537 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27d6786b-675a-45da-9127-0e37d1adb574 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:30.168487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27d6786b-675a-45da-9127-0e37d1adb574 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:30.455283 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-27d6786b-675a-45da-9127-0e37d1adb574 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:30.503281 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-27d6786b-675a-45da-9127-0e37d1adb574 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.416118 Jul 04 08:04:30.509704 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 55/109] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:30 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:30.523717 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:30.524765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:30.533858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:30.534819 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:30.536429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:30.537105 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:30.551348 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e2b8e8af-9b6f-4428-b6d3-9d075e0459b5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:30.574401 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e2b8e8af-9b6f-4428-b6d3-9d075e0459b5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.561917 Jul 04 08:04:30.579986 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 55/110] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:30 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:30.798898 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-9d4fa472-2022-423f-920e-e1b813de2068 req-c4df2029-f337-431c-9937-9be1fa81e4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd9e555-ba83-4ef3-b775-12ea3083901b", "name": "network-vif-plugged", "status": "completed", "tag": "b25ad08a-5d11-4942-8c91-fbb1ec88fba2"}, {"server_uuid": "3ce6703a-43b5-47a0-8d17-1794e718e3b1", "name": "network-vif-plugged", "status": "completed", "tag": "525c4cce-65e1-4ea7-8d82-0a5a7a69ede9"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:30.831775 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-9d4fa472-2022-423f-920e-e1b813de2068 req-c4df2029-f337-431c-9937-9be1fa81e4a3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:30.832211 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-9d4fa472-2022-423f-920e-e1b813de2068 req-c4df2029-f337-431c-9937-9be1fa81e4a3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:30.856807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:30.857950 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-9d4fa472-2022-423f-920e-e1b813de2068 req-c4df2029-f337-431c-9937-9be1fa81e4a3 service nova] Creating event network-vif-plugged:b25ad08a-5d11-4942-8c91-fbb1ec88fba2 for instance 1cd9e555-ba83-4ef3-b775-12ea3083901b on hv-cinder-79760 Jul 04 08:04:30.858495 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-9d4fa472-2022-423f-920e-e1b813de2068 req-c4df2029-f337-431c-9937-9be1fa81e4a3 service nova] Creating event network-vif-plugged:525c4cce-65e1-4ea7-8d82-0a5a7a69ede9 for instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 on hv-cinder-79760 Jul 04 08:04:30.875005 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-9d4fa472-2022-423f-920e-e1b813de2068 req-c4df2029-f337-431c-9937-9be1fa81e4a3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079523 Jul 04 08:04:30.875617 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 56/111] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:30.887632 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:30.890326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:30.891502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-01180cb4-6525-4f03-bcbb-f008019f982c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.385206 Jul 04 08:04:30.892074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 56/112] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:30 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:30.913841 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2459fd0f-ee6d-4910-95d4-0f616893824a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:30.915002 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2459fd0f-ee6d-4910-95d4-0f616893824a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:30.926981 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2459fd0f-ee6d-4910-95d4-0f616893824a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:30.927769 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2459fd0f-ee6d-4910-95d4-0f616893824a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:30.929075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2459fd0f-ee6d-4910-95d4-0f616893824a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:30.929819 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2459fd0f-ee6d-4910-95d4-0f616893824a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:31.138183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2459fd0f-ee6d-4910-95d4-0f616893824a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:31.152679 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2459fd0f-ee6d-4910-95d4-0f616893824a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.247697 Jul 04 08:04:31.154301 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 57/113] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:30 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:31.533739 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-985b1831-8773-4920-ae13-8036876dcb90 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:31.534901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-985b1831-8773-4920-ae13-8036876dcb90 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:31.541853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-985b1831-8773-4920-ae13-8036876dcb90 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:31.542455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-985b1831-8773-4920-ae13-8036876dcb90 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:31.543376 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-985b1831-8773-4920-ae13-8036876dcb90 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:31.544000 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-985b1831-8773-4920-ae13-8036876dcb90 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:31.602005 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-835fa02c-4a3a-4e08-a2c7-17ece7d5d532 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:31.610354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-835fa02c-4a3a-4e08-a2c7-17ece7d5d532 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:31.632048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-835fa02c-4a3a-4e08-a2c7-17ece7d5d532 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:31.633870 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-835fa02c-4a3a-4e08-a2c7-17ece7d5d532 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:31.635282 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-835fa02c-4a3a-4e08-a2c7-17ece7d5d532 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:31.636658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-835fa02c-4a3a-4e08-a2c7-17ece7d5d532 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:31.826205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-985b1831-8773-4920-ae13-8036876dcb90 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:31.836042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-985b1831-8773-4920-ae13-8036876dcb90 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.306189 Jul 04 08:04:31.847835 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 57/114] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:31 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:31.911132 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:31.912543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:31.931828 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:31.932285 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:31.936004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:31.938765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:32.242606 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-835fa02c-4a3a-4e08-a2c7-17ece7d5d532 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:32.252679 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-835fa02c-4a3a-4e08-a2c7-17ece7d5d532 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1361 microversion: 2.1 time: 0.658456 Jul 04 08:04:32.267749 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 58/115] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:31 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1361 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:32.274053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-89ca6dfc-7a83-4611-ab68-2748313c31cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:32.275015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-89ca6dfc-7a83-4611-ab68-2748313c31cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:32.281955 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89ca6dfc-7a83-4611-ab68-2748313c31cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:32.282757 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89ca6dfc-7a83-4611-ab68-2748313c31cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:32.283757 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89ca6dfc-7a83-4611-ab68-2748313c31cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:32.284414 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-89ca6dfc-7a83-4611-ab68-2748313c31cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:32.308550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:32.318680 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:32.320493 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:32.321716 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-558c4d3b-879f-469d-8b8f-4047e7b54e9c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.414611 Jul 04 08:04:32.322392 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 58/116] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:31 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:04:32.532146 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-89ca6dfc-7a83-4611-ab68-2748313c31cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:32.549229 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-89ca6dfc-7a83-4611-ab68-2748313c31cc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.279650 Jul 04 08:04:32.549977 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 59/117] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:32 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:32.859954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6b9223a7-311e-4a54-9c63-8589e8781ac7 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:32.861737 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6b9223a7-311e-4a54-9c63-8589e8781ac7 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:32.877088 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9223a7-311e-4a54-9c63-8589e8781ac7 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:32.878627 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9223a7-311e-4a54-9c63-8589e8781ac7 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:32.880804 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9223a7-311e-4a54-9c63-8589e8781ac7 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:32.881954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9223a7-311e-4a54-9c63-8589e8781ac7 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:32.899941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-1a484811-7ada-4d79-beb2-39575067ecbb req-de6b65bc-4ba9-4ff4-80e4-f1af642d8c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42c331b-8c2a-4f37-bd0a-7221b07bf3af", "name": "network-vif-plugged", "status": "completed", "tag": "624f3113-8fef-448f-b1f3-28db878c297b"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:32.937417 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1a484811-7ada-4d79-beb2-39575067ecbb req-de6b65bc-4ba9-4ff4-80e4-f1af642d8c3d service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:32.938199 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1a484811-7ada-4d79-beb2-39575067ecbb req-de6b65bc-4ba9-4ff4-80e4-f1af642d8c3d service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:32.978946 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-1a484811-7ada-4d79-beb2-39575067ecbb req-de6b65bc-4ba9-4ff4-80e4-f1af642d8c3d service nova] Creating event network-vif-plugged:624f3113-8fef-448f-b1f3-28db878c297b for instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af on hv-cinder-79760 Jul 04 08:04:32.995807 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-1a484811-7ada-4d79-beb2-39575067ecbb req-de6b65bc-4ba9-4ff4-80e4-f1af642d8c3d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101048 Jul 04 08:04:33.000220 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 60/118] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:33.255333 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6b9223a7-311e-4a54-9c63-8589e8781ac7 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:33.266867 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6b9223a7-311e-4a54-9c63-8589e8781ac7 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1314 microversion: 2.1 time: 0.415236 Jul 04 08:04:33.274252 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 59/119] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:32 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:33.294191 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7ec4dad4-e6da-4dba-908a-daf3a3630ad8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:33.295254 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7ec4dad4-e6da-4dba-908a-daf3a3630ad8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:33.307274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ec4dad4-e6da-4dba-908a-daf3a3630ad8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:33.308098 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ec4dad4-e6da-4dba-908a-daf3a3630ad8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:33.309490 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ec4dad4-e6da-4dba-908a-daf3a3630ad8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:33.310238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7ec4dad4-e6da-4dba-908a-daf3a3630ad8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:33.341351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:33.342055 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:33.348541 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:33.349500 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:33.350761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:33.351506 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:33.573241 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7ec4dad4-e6da-4dba-908a-daf3a3630ad8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:33.585562 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7ec4dad4-e6da-4dba-908a-daf3a3630ad8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1548 microversion: 2.1 time: 0.308702 Jul 04 08:04:33.586210 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 61/120] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:33 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1548 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:33.588393 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:33.604308 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-26b7ca2c-8c74-4551-9e0d-30c5ddd9f77c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:33.604934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-26b7ca2c-8c74-4551-9e0d-30c5ddd9f77c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:33.611627 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26b7ca2c-8c74-4551-9e0d-30c5ddd9f77c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:33.612043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26b7ca2c-8c74-4551-9e0d-30c5ddd9f77c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:33.613046 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26b7ca2c-8c74-4551-9e0d-30c5ddd9f77c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:33.613572 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26b7ca2c-8c74-4551-9e0d-30c5ddd9f77c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:33.625603 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:33.629006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:33.637241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-56c58901-3aa3-4f9a-9444-d736d52f8ed2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.300197 Jul 04 08:04:33.654720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 60/121] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:33 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:04:33.666926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8ffdf905-3d9e-47d9-aa19-535bc1486b97 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:33.668215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8ffdf905-3d9e-47d9-aa19-535bc1486b97 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:33.683232 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8ffdf905-3d9e-47d9-aa19-535bc1486b97 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:33.684808 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8ffdf905-3d9e-47d9-aa19-535bc1486b97 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:33.686308 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8ffdf905-3d9e-47d9-aa19-535bc1486b97 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:33.686824 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8ffdf905-3d9e-47d9-aa19-535bc1486b97 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:33.818708 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-26b7ca2c-8c74-4551-9e0d-30c5ddd9f77c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:33.828415 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-26b7ca2c-8c74-4551-9e0d-30c5ddd9f77c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1368 microversion: 2.1 time: 0.229087 Jul 04 08:04:33.838819 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 62/122] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:33 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:33.896667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8ffdf905-3d9e-47d9-aa19-535bc1486b97 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.240078 Jul 04 08:04:33.897868 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 61/123] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jul 4 08:04:33 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/os-interface => generated 285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:34.295224 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8cfdb227-6309-4a05-abeb-39388b2db4e0 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:34.296681 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8cfdb227-6309-4a05-abeb-39388b2db4e0 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:34.299115 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=68 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:34.308781 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cfdb227-6309-4a05-abeb-39388b2db4e0 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:34.309820 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cfdb227-6309-4a05-abeb-39388b2db4e0 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:34.310943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cfdb227-6309-4a05-abeb-39388b2db4e0 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:34.311601 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cfdb227-6309-4a05-abeb-39388b2db4e0 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:34.669910 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:34.670497 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:34.684051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:34.684501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:34.686469 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:34.693574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:34.888883 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:34.893881 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:34.912346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:34.914547 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:34.917029 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-97c12994-744f-490e-87d0-ede9d96e7385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.251212 Jul 04 08:04:34.923028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8cfdb227-6309-4a05-abeb-39388b2db4e0 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:34.926386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 62/124] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:34 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:34.938361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-96f80ccf-065f-434d-9950-b0195dc17026 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:34.939282 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-96f80ccf-065f-434d-9950-b0195dc17026 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:34.939981 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8cfdb227-6309-4a05-abeb-39388b2db4e0 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1501 microversion: 2.1 time: 0.644162 Jul 04 08:04:34.946760 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 63/125] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:34 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1501 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:34.947949 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-96f80ccf-065f-434d-9950-b0195dc17026 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:34.948422 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-96f80ccf-065f-434d-9950-b0195dc17026 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:34.949609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-96f80ccf-065f-434d-9950-b0195dc17026 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:34.950082 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-96f80ccf-065f-434d-9950-b0195dc17026 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:35.229001 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-96f80ccf-065f-434d-9950-b0195dc17026 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:35.253291 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-96f80ccf-065f-434d-9950-b0195dc17026 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1558 microversion: 2.1 time: 0.323092 Jul 04 08:04:35.257014 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 63/126] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:34 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1558 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:35.368355 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-938d9e01-bfc7-41c1-94a6-5c94e4348b34 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:35.369528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-938d9e01-bfc7-41c1-94a6-5c94e4348b34 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:35.395383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-938d9e01-bfc7-41c1-94a6-5c94e4348b34 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:35.395894 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-938d9e01-bfc7-41c1-94a6-5c94e4348b34 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:35.396860 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-938d9e01-bfc7-41c1-94a6-5c94e4348b34 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:35.397448 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-938d9e01-bfc7-41c1-94a6-5c94e4348b34 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:35.621532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-938d9e01-bfc7-41c1-94a6-5c94e4348b34 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.299792 Jul 04 08:04:35.622623 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 64/127] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jul 4 08:04:35 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-interface => generated 284 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:04:35.949532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:35.951924 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:35.967043 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:35.968085 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:35.969950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:35.971805 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:36.200866 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:36.213065 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:36.215757 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:36.220232 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6064365e-bde8-44db-b646-b326c373df1e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1407 microversion: 2.20 time: 0.274900 Jul 04 08:04:36.231873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 64/128] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:35 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:04:36.468501 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-f6524f19-80c6-41b6-9412-0642ef54697b req-d5703948-acc0-4c96-9616-bbd99cb3d9c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b415c8c-45f0-4469-82d4-a3b8c3c6145f", "tag": "84fb4212-970a-48e7-a1ab-238bd3c64f6a"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:36.479840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f6524f19-80c6-41b6-9412-0642ef54697b req-d5703948-acc0-4c96-9616-bbd99cb3d9c7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:36.480844 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f6524f19-80c6-41b6-9412-0642ef54697b req-d5703948-acc0-4c96-9616-bbd99cb3d9c7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:36.506939 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-f6524f19-80c6-41b6-9412-0642ef54697b req-d5703948-acc0-4c96-9616-bbd99cb3d9c7 service nova] Creating event network-changed:84fb4212-970a-48e7-a1ab-238bd3c64f6a for instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f on hv-cinder-79760 Jul 04 08:04:36.515182 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-f6524f19-80c6-41b6-9412-0642ef54697b req-d5703948-acc0-4c96-9616-bbd99cb3d9c7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050725 Jul 04 08:04:36.516472 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 65/129] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:36.775319 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f5b7b5d9-8e34-43f9-a127-dc1a9e4f73eb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e808e947-d95e-490a-bb3d-23e6ee76bfd4"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:36.777181 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f5b7b5d9-8e34-43f9-a127-dc1a9e4f73eb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:36.787883 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f5b7b5d9-8e34-43f9-a127-dc1a9e4f73eb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:36.789128 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f5b7b5d9-8e34-43f9-a127-dc1a9e4f73eb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:36.790847 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f5b7b5d9-8e34-43f9-a127-dc1a9e4f73eb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:36.791878 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f5b7b5d9-8e34-43f9-a127-dc1a9e4f73eb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:37.261952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:37.266428 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:37.288246 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:37.289359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:37.291423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:37.292477 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:37.709037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f5b7b5d9-8e34-43f9-a127-dc1a9e4f73eb tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "POST /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.939106 Jul 04 08:04:37.722164 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 65/130] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:04:36 2022] POST /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b/os-volume_attachments => generated 194 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:37.983437 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:38.036972 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:38.040106 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:38.042284 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0cfdc2af-ddc5-42ba-ab1e-44f32dfb64ea tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1600 microversion: 2.20 time: 0.794060 Jul 04 08:04:38.043328 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 66/131] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:04:37 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1600 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:04:38.063424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-68cfe739-9d13-499c-a60c-26c554e1af12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:38.064246 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-68cfe739-9d13-499c-a60c-26c554e1af12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:38.071837 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=79 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:38.074254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68cfe739-9d13-499c-a60c-26c554e1af12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:38.074788 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68cfe739-9d13-499c-a60c-26c554e1af12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:38.075983 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68cfe739-9d13-499c-a60c-26c554e1af12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:38.076539 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68cfe739-9d13-499c-a60c-26c554e1af12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:38.246385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-68cfe739-9d13-499c-a60c-26c554e1af12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.187519 Jul 04 08:04:38.248360 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 66/132] 10.222.0.43 () {60 vars in 1315 bytes} [Mon Jul 4 08:04:38 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 08:04:38.537116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-7fb6efba-f864-4058-b2f5-57b7f3090741 req-a43415a8-8cc0-417c-8494-9207b31d1e42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ce6703a-43b5-47a0-8d17-1794e718e3b1", "tag": "525c4cce-65e1-4ea7-8d82-0a5a7a69ede9"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:38.549975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7fb6efba-f864-4058-b2f5-57b7f3090741 req-a43415a8-8cc0-417c-8494-9207b31d1e42 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:38.550597 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7fb6efba-f864-4058-b2f5-57b7f3090741 req-a43415a8-8cc0-417c-8494-9207b31d1e42 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:38.578547 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-7fb6efba-f864-4058-b2f5-57b7f3090741 req-a43415a8-8cc0-417c-8494-9207b31d1e42 service nova] Creating event network-changed:525c4cce-65e1-4ea7-8d82-0a5a7a69ede9 for instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 on hv-cinder-79760 Jul 04 08:04:38.593578 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-7fb6efba-f864-4058-b2f5-57b7f3090741 req-a43415a8-8cc0-417c-8494-9207b31d1e42 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060608 Jul 04 08:04:38.594251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 67/133] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:04:40.468267 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-702afd19-6002-4cc4-a2d6-9ab75e1efd33 req-f25e68d8-d14b-4828-b00f-cb81cff481ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a42c331b-8c2a-4f37-bd0a-7221b07bf3af", "tag": "624f3113-8fef-448f-b1f3-28db878c297b"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:40.481342 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-702afd19-6002-4cc4-a2d6-9ab75e1efd33 req-f25e68d8-d14b-4828-b00f-cb81cff481ad service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:40.482248 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-702afd19-6002-4cc4-a2d6-9ab75e1efd33 req-f25e68d8-d14b-4828-b00f-cb81cff481ad service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:40.497509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-702afd19-6002-4cc4-a2d6-9ab75e1efd33 req-f25e68d8-d14b-4828-b00f-cb81cff481ad service nova] Creating event network-changed:624f3113-8fef-448f-b1f3-28db878c297b for instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af on hv-cinder-79760 Jul 04 08:04:40.506098 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-702afd19-6002-4cc4-a2d6-9ab75e1efd33 req-f25e68d8-d14b-4828-b00f-cb81cff481ad service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041261 Jul 04 08:04:40.507179 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 67/134] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:04:54.124029 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=9 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:54.125169 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=70 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:54.132134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-68f9c022-fd7f-4c4f-8705-f05fd3b6bd88 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:54.132831 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-68f9c022-fd7f-4c4f-8705-f05fd3b6bd88 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:54.141698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68f9c022-fd7f-4c4f-8705-f05fd3b6bd88 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:54.142161 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68f9c022-fd7f-4c4f-8705-f05fd3b6bd88 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:54.142970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68f9c022-fd7f-4c4f-8705-f05fd3b6bd88 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:54.144462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-68f9c022-fd7f-4c4f-8705-f05fd3b6bd88 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:54.188462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-68f9c022-fd7f-4c4f-8705-f05fd3b6bd88 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:04:54.360554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-68f9c022-fd7f-4c4f-8705-f05fd3b6bd88 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 204 len: 0 microversion: 2.1 time: 0.237181 Jul 04 08:04:54.361404 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 68/135] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:04:54 2022] DELETE /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:04:54.369674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:54.370895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:04:54.378414 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-85e65da7-3d3f-4085-9f0d-9fd11a6d29ad tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:54.379830 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-85e65da7-3d3f-4085-9f0d-9fd11a6d29ad tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:54.395562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85e65da7-3d3f-4085-9f0d-9fd11a6d29ad tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:54.396005 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85e65da7-3d3f-4085-9f0d-9fd11a6d29ad tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:54.396792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85e65da7-3d3f-4085-9f0d-9fd11a6d29ad tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:54.397388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85e65da7-3d3f-4085-9f0d-9fd11a6d29ad tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:54.639163 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-85e65da7-3d3f-4085-9f0d-9fd11a6d29ad tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:54.654258 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-85e65da7-3d3f-4085-9f0d-9fd11a6d29ad tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1553 microversion: 2.1 time: 0.286855 Jul 04 08:04:54.655451 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 68/136] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:54 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:55.681940 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-92253722-9326-48df-9bb0-9108190516ed tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:55.682751 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-92253722-9326-48df-9bb0-9108190516ed tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:55.691143 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-92253722-9326-48df-9bb0-9108190516ed tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:55.691585 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-92253722-9326-48df-9bb0-9108190516ed tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:55.692878 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-92253722-9326-48df-9bb0-9108190516ed tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:55.693490 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-92253722-9326-48df-9bb0-9108190516ed tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:55.889323 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-92253722-9326-48df-9bb0-9108190516ed tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:55.901187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-92253722-9326-48df-9bb0-9108190516ed tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1553 microversion: 2.1 time: 0.223584 Jul 04 08:04:55.901809 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 69/137] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:55 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1553 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:56.934041 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4fa8e91e-af53-43b4-9cc2-9984b3728aec tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:56.935339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4fa8e91e-af53-43b4-9cc2-9984b3728aec tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:56.944677 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fa8e91e-af53-43b4-9cc2-9984b3728aec tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:56.945553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fa8e91e-af53-43b4-9cc2-9984b3728aec tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:56.946868 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fa8e91e-af53-43b4-9cc2-9984b3728aec tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:56.947681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fa8e91e-af53-43b4-9cc2-9984b3728aec tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:57.154226 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4fa8e91e-af53-43b4-9cc2-9984b3728aec tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:57.167618 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4fa8e91e-af53-43b4-9cc2-9984b3728aec tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1553 microversion: 2.1 time: 0.236481 Jul 04 08:04:57.168565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 69/138] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:56 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1553 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:04:57.835664 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-8e72099c-1edf-4111-951c-1f90e1f7225a req-7db3fe76-bf9f-433c-8f75-3914e98dc7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd9e555-ba83-4ef3-b775-12ea3083901b", "name": "network-vif-deleted", "tag": "b25ad08a-5d11-4942-8c91-fbb1ec88fba2"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:04:57.867431 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-8e72099c-1edf-4111-951c-1f90e1f7225a req-7db3fe76-bf9f-433c-8f75-3914e98dc7ed service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:57.867870 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-8e72099c-1edf-4111-951c-1f90e1f7225a req-7db3fe76-bf9f-433c-8f75-3914e98dc7ed service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:57.896327 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-8e72099c-1edf-4111-951c-1f90e1f7225a req-7db3fe76-bf9f-433c-8f75-3914e98dc7ed service nova] Creating event network-vif-deleted:b25ad08a-5d11-4942-8c91-fbb1ec88fba2 for instance 1cd9e555-ba83-4ef3-b775-12ea3083901b on hv-cinder-79760 Jul 04 08:04:57.910863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-8e72099c-1edf-4111-951c-1f90e1f7225a req-7db3fe76-bf9f-433c-8f75-3914e98dc7ed service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081850 Jul 04 08:04:57.915067 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 70/139] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:04:58.187545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-040e3c2b-8863-4133-8c68-794fa09b7c4a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:58.188409 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-040e3c2b-8863-4133-8c68-794fa09b7c4a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:58.195596 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-040e3c2b-8863-4133-8c68-794fa09b7c4a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:58.196048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-040e3c2b-8863-4133-8c68-794fa09b7c4a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:58.196841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-040e3c2b-8863-4133-8c68-794fa09b7c4a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:58.197276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-040e3c2b-8863-4133-8c68-794fa09b7c4a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:58.279243 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-040e3c2b-8863-4133-8c68-794fa09b7c4a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31fe6ac873124636977d593ad5dc2b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7de2b98bf8c340d0b7646468c3594a47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:04:58.289386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-040e3c2b-8863-4133-8c68-794fa09b7c4a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 200 len: 1345 microversion: 2.1 time: 0.106185 Jul 04 08:04:58.290272 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 70/140] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:58 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 1345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:04:59.317166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:59.318374 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:59.329137 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:59.329921 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:59.332453 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:59.333300 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:59.361318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] HTTP exception thrown: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Request method failure captured: Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b HTTP/1.1 Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7hdR3c8pHqOtPDcodGv03wntSYAb36aJtRDW2vylJlA8fgHLrwJZOB2tDEkBIx_CIrVVWHdZ6MiTwHvb11IUCdfdN3Yayxk2edenibpte_8zKP1rh581qOKoiF6U5YXzR1TonE2bbLfd5Gza4G0CBVLHCYw6l69n5_qfIwOBOsG-c Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 7de2b98bf8c340d0b7646468c3594a47 Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:04:59.395238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7de2b98bf8c340d0b7646468c3594a47", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 7de2b98bf8c340d0b7646468c3594a47 Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-DeleteServersTestJSON-1461579018-project Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 31fe6ac873124636977d593ad5dc2b65 Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-DeleteServersTestJSON-1461579018-project Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.396804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '1cd9e555-ba83-4ef3-b775-12ea3083901b'} Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:04:59.398141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.400157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.402071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Returning 404 to user: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:04:59.402071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-837c46ba-3bab-4d65-9742-5b284aab3aa1 tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 404 len: 111 microversion: 2.1 time: 0.087702 Jul 04 08:04:59.402071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 71/141] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:04:59 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:04:59.581964 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:04:59.583544 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:04:59.595323 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:59.596821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:59.598477 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:04:59.599233 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:04:59.625653 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] HTTP exception thrown: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Request method failure captured: Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b/os-volume_attachments HTTP/1.1 Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7hdR3c8pHqOtPDcodGv03wntSYAb36aJtRDW2vylJlA8fgHLrwJZOB2tDEkBIx_CIrVVWHdZ6MiTwHvb11IUCdfdN3Yayxk2edenibpte_8zKP1rh581qOKoiF6U5YXzR1TonE2bbLfd5Gza4G0CBVLHCYw6l69n5_qfIwOBOsG-c Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 7de2b98bf8c340d0b7646468c3594a47 Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:04:59.640597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7de2b98bf8c340d0b7646468c3594a47", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 7de2b98bf8c340d0b7646468c3594a47 Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-DeleteServersTestJSON-1461579018-project Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 31fe6ac873124636977d593ad5dc2b65 Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-DeleteServersTestJSON-1461579018-project Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.642674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'server_id': '1cd9e555-ba83-4ef3-b775-12ea3083901b'} Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:04:59.643578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:04:59.645101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:04:59.646436 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Returning 404 to user: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:04:59.646436 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9553ea28-e1f0-471e-9308-1d4530a7d80a tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.068636 Jul 04 08:04:59.646436 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 71/142] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:04:59 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:05:01.089224 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:01.090123 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:01.102655 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:01.103405 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:01.105312 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:01.106335 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:01.136241 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] HTTP exception thrown: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Request method failure captured: Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: DELETE /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b HTTP/1.1 Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7hdR3c8pHqOtPDcodGv03wntSYAb36aJtRDW2vylJlA8fgHLrwJZOB2tDEkBIx_CIrVVWHdZ6MiTwHvb11IUCdfdN3Yayxk2edenibpte_8zKP1rh581qOKoiF6U5YXzR1TonE2bbLfd5Gza4G0CBVLHCYw6l69n5_qfIwOBOsG-c Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 7de2b98bf8c340d0b7646468c3594a47 Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:05:01.139358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7de2b98bf8c340d0b7646468c3594a47", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 7de2b98bf8c340d0b7646468c3594a47 Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-DeleteServersTestJSON-1461579018-project Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 31fe6ac873124636977d593ad5dc2b65 Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-DeleteServersTestJSON-1461579018-project Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.141926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '1cd9e555-ba83-4ef3-b775-12ea3083901b'} Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:05:01.143608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.145834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.148011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Returning 404 to user: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:05:01.148011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f0c39ec7-0b15-4fe7-9110-cd35e157a83d tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 404 len: 111 microversion: 2.1 time: 0.061121 Jul 04 08:05:01.149157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 72/143] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:05:01 2022] DELETE /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:05:01.154913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:01.155969 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] [instance: 1cd9e555-ba83-4ef3-b775-12ea3083901b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:01.165226 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:01.165883 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:01.166850 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:01.167436 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:01.190444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] HTTP exception thrown: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Request method failure captured: Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b HTTP/1.1 Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7hdR3c8pHqOtPDcodGv03wntSYAb36aJtRDW2vylJlA8fgHLrwJZOB2tDEkBIx_CIrVVWHdZ6MiTwHvb11IUCdfdN3Yayxk2edenibpte_8zKP1rh581qOKoiF6U5YXzR1TonE2bbLfd5Gza4G0CBVLHCYw6l69n5_qfIwOBOsG-c Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 7de2b98bf8c340d0b7646468c3594a47 Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:05:01.194502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/7de2b98bf8c340d0b7646468c3594a47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_7de2b98bf8c340d0b7646468c3594a47", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 7de2b98bf8c340d0b7646468c3594a47 Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1461579018 Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-DeleteServersTestJSON-1461579018-project Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 31fe6ac873124636977d593ad5dc2b65 Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-DeleteServersTestJSON-1461579018-project Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.196527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '1cd9e555-ba83-4ef3-b775-12ea3083901b'} Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:05:01.197253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. Jul 04 08:05:01.203748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:01.205996 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] Returning 404 to user: Instance 1cd9e555-ba83-4ef3-b775-12ea3083901b could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:05:01.205996 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2b59c950-aed2-499d-b24b-f979871597da tempest-DeleteServersTestJSON-1461579018 tempest-DeleteServersTestJSON-1461579018-project] 10.222.0.43 "GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b" status: 404 len: 111 microversion: 2.1 time: 0.046330 Jul 04 08:05:01.205996 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 72/144] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:01 2022] GET /compute/v2.1/servers/1cd9e555-ba83-4ef3-b775-12ea3083901b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:05:14.981293 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:14.983658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:15.185033 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-344400475", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:15.289246 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] validate_networks() for [('c274a709-4c9c-4dc4-892d-1096227b79fc', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:05:15.905824 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:05:15.907789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:05:15.908873 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:05:15.909772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:05:15.911879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:05:15.927935 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:15.928711 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:15.930462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:15.931507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:15.960912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Getting quotas for project ecd5bc804a3b4f14b864fb4e0f8d1b98. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:05:15.966871 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Getting quotas for user 9e3f73e469f34b66bfbe99c3d79ac129 and project ecd5bc804a3b4f14b864fb4e0f8d1b98. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:05:15.993427 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:05:15.996079 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:05:16.070456 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ca19c1e3-7af9-4197-b5a2-be3fdd948e57 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.098505 Jul 04 08:05:16.071474 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 73/145] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:05:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:05:16.088289 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-eeb8dd96-61e9-4c20-aed2-5b5968bb6e78 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:16.104707 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-eeb8dd96-61e9-4c20-aed2-5b5968bb6e78 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:16.108698 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=10 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:16.109939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=22 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:16.220346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-eeb8dd96-61e9-4c20-aed2-5b5968bb6e78 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:16.228992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-eeb8dd96-61e9-4c20-aed2-5b5968bb6e78 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1221 microversion: 2.1 time: 0.148436 Jul 04 08:05:16.229590 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 73/146] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:16 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:16.480426 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1742884215", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:16.556634 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] validate_networks() for [('c274a709-4c9c-4dc4-892d-1096227b79fc', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:05:17.404381 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:05:17.405053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:05:17.405256 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:05:17.405684 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:05:17.406099 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:05:17.416994 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:17.417412 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:17.418342 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:17.418943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:17.442265 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Getting quotas for project ecd5bc804a3b4f14b864fb4e0f8d1b98. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:05:17.446885 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Getting quotas for user 9e3f73e469f34b66bfbe99c3d79ac129 and project ecd5bc804a3b4f14b864fb4e0f8d1b98. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:05:17.462621 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:05:17.465218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:05:17.525138 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7f8aaf26-b313-4bce-8a2c-2ce75a40793b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.051501 Jul 04 08:05:17.526605 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 74/147] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:05:16 2022] POST /compute/v2.1/servers => generated 383 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:05:17.538180 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4f9e4e8f-c615-4ec4-a72b-04a33cd716e9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:17.539536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4f9e4e8f-c615-4ec4-a72b-04a33cd716e9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:17.649240 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4f9e4e8f-c615-4ec4-a72b-04a33cd716e9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:17.657812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4f9e4e8f-c615-4ec4-a72b-04a33cd716e9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1222 microversion: 2.1 time: 0.124316 Jul 04 08:05:17.659739 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 74/148] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:17 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:18.678493 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-05eef201-2736-47ae-815f-b864e8cde2d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:18.679167 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-05eef201-2736-47ae-815f-b864e8cde2d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:18.696724 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-05eef201-2736-47ae-815f-b864e8cde2d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:18.699919 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-05eef201-2736-47ae-815f-b864e8cde2d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:18.705084 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-05eef201-2736-47ae-815f-b864e8cde2d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:18.706336 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-05eef201-2736-47ae-815f-b864e8cde2d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:18.909075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-05eef201-2736-47ae-815f-b864e8cde2d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:18.921492 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-05eef201-2736-47ae-815f-b864e8cde2d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1218 microversion: 2.1 time: 0.248075 Jul 04 08:05:18.933492 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 75/149] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:18 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1218 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:19.942968 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e9820137-1568-4eb7-a774-bc3c6e397864 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:19.944472 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e9820137-1568-4eb7-a774-bc3c6e397864 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:19.978140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9820137-1568-4eb7-a774-bc3c6e397864 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:19.981413 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9820137-1568-4eb7-a774-bc3c6e397864 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:19.983396 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9820137-1568-4eb7-a774-bc3c6e397864 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:19.984886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9820137-1568-4eb7-a774-bc3c6e397864 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:20.120413 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e9820137-1568-4eb7-a774-bc3c6e397864 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:20.142787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e9820137-1568-4eb7-a774-bc3c6e397864 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1280 microversion: 2.1 time: 0.205496 Jul 04 08:05:20.143753 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 75/150] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:19 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1280 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:21.162343 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-965dc8b8-c2cf-4684-8202-ebae9a36b3b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:21.164964 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-965dc8b8-c2cf-4684-8202-ebae9a36b3b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:21.182641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-965dc8b8-c2cf-4684-8202-ebae9a36b3b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:21.183494 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-965dc8b8-c2cf-4684-8202-ebae9a36b3b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:21.185738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-965dc8b8-c2cf-4684-8202-ebae9a36b3b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:21.187611 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-965dc8b8-c2cf-4684-8202-ebae9a36b3b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:21.852327 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-965dc8b8-c2cf-4684-8202-ebae9a36b3b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:21.861491 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-965dc8b8-c2cf-4684-8202-ebae9a36b3b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.704618 Jul 04 08:05:21.862888 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 76/151] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:21 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:22.173031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-98b858c7-adcc-4383-95f9-324199dce0b9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:22.174424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-98b858c7-adcc-4383-95f9-324199dce0b9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:22.192276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98b858c7-adcc-4383-95f9-324199dce0b9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:22.193071 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98b858c7-adcc-4383-95f9-324199dce0b9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:22.194451 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98b858c7-adcc-4383-95f9-324199dce0b9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:22.195173 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98b858c7-adcc-4383-95f9-324199dce0b9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:22.245316 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-98b858c7-adcc-4383-95f9-324199dce0b9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/ips" status: 200 len: 147 microversion: 2.1 time: 0.078492 Jul 04 08:05:22.246045 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 76/152] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:05:22 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/ips => generated 147 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:22.895488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-97e21e5d-8d3c-4310-bde2-e6deeba68118 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:22.897410 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-97e21e5d-8d3c-4310-bde2-e6deeba68118 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:22.918473 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97e21e5d-8d3c-4310-bde2-e6deeba68118 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:22.923701 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97e21e5d-8d3c-4310-bde2-e6deeba68118 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:22.926320 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97e21e5d-8d3c-4310-bde2-e6deeba68118 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:22.936897 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-10bbac53-b009-4137-aa54-1cd95b70b74e req-0b582c60-5d9c-434f-993c-249ba206bf63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d58cef-2712-485a-a46d-b96178458181", "tag": "bc0b4523-5b60-4757-aa81-8ac852d68a9d"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:22.942267 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97e21e5d-8d3c-4310-bde2-e6deeba68118 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:22.960604 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-10bbac53-b009-4137-aa54-1cd95b70b74e req-0b582c60-5d9c-434f-993c-249ba206bf63 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:22.961052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-10bbac53-b009-4137-aa54-1cd95b70b74e req-0b582c60-5d9c-434f-993c-249ba206bf63 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:23.015005 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-10bbac53-b009-4137-aa54-1cd95b70b74e req-0b582c60-5d9c-434f-993c-249ba206bf63 service nova] Creating event network-changed:bc0b4523-5b60-4757-aa81-8ac852d68a9d for instance 07d58cef-2712-485a-a46d-b96178458181 on hv-cinder-79760 Jul 04 08:05:23.039059 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-10bbac53-b009-4137-aa54-1cd95b70b74e req-0b582c60-5d9c-434f-993c-249ba206bf63 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108563 Jul 04 08:05:23.039706 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 77/153] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:05:23.622058 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-97e21e5d-8d3c-4310-bde2-e6deeba68118 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:23.638237 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-97e21e5d-8d3c-4310-bde2-e6deeba68118 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.752069 Jul 04 08:05:23.646821 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 77/154] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:22 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:24.657451 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0e3d82fa-02e0-4992-8980-8700b43bb6b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:24.658477 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0e3d82fa-02e0-4992-8980-8700b43bb6b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:24.666266 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e3d82fa-02e0-4992-8980-8700b43bb6b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:24.666691 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e3d82fa-02e0-4992-8980-8700b43bb6b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:24.667507 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e3d82fa-02e0-4992-8980-8700b43bb6b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:24.667997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e3d82fa-02e0-4992-8980-8700b43bb6b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:24.745867 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e31c2132-2e81-4ecb-9aeb-e3a1c83573fd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:24.746694 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e31c2132-2e81-4ecb-9aeb-e3a1c83573fd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:24.753763 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e31c2132-2e81-4ecb-9aeb-e3a1c83573fd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:24.754300 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e31c2132-2e81-4ecb-9aeb-e3a1c83573fd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:24.755274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e31c2132-2e81-4ecb-9aeb-e3a1c83573fd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:24.755918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e31c2132-2e81-4ecb-9aeb-e3a1c83573fd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:24.788074 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e31c2132-2e81-4ecb-9aeb-e3a1c83573fd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/ips" status: 200 len: 150 microversion: 2.1 time: 0.046456 Jul 04 08:05:24.788981 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 78/155] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:05:24 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/ips => generated 150 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:24.828338 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0e3d82fa-02e0-4992-8980-8700b43bb6b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:24.836614 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0e3d82fa-02e0-4992-8980-8700b43bb6b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.183664 Jul 04 08:05:24.837407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 78/156] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:24 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:25.073211 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-b927af1c-6423-4b34-ac3f-ac5f5e3dde9d req-831a3fb2-fed7-4561-905c-a91a7384f074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d165c5-1758-4475-b335-7eb6f12f7d3c", "tag": "e31114ef-5009-42b7-86f6-1482f88fd705"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:25.090182 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b927af1c-6423-4b34-ac3f-ac5f5e3dde9d req-831a3fb2-fed7-4561-905c-a91a7384f074 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:25.091232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b927af1c-6423-4b34-ac3f-ac5f5e3dde9d req-831a3fb2-fed7-4561-905c-a91a7384f074 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:25.109354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-b927af1c-6423-4b34-ac3f-ac5f5e3dde9d req-831a3fb2-fed7-4561-905c-a91a7384f074 service nova] Creating event network-changed:e31114ef-5009-42b7-86f6-1482f88fd705 for instance c5d165c5-1758-4475-b335-7eb6f12f7d3c on hv-cinder-79760 Jul 04 08:05:25.119489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-b927af1c-6423-4b34-ac3f-ac5f5e3dde9d req-831a3fb2-fed7-4561-905c-a91a7384f074 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051280 Jul 04 08:05:25.120869 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 79/157] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:25.194758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1039171825", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:25.264339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] validate_networks() for None {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:05:25.593520 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:05:25.594437 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:05:25.595103 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:05:25.595675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:05:25.596214 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:05:25.608968 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:25.609415 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:25.610270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:25.610706 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:25.629451 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-572375747", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "networks": [{"uuid": "498c549c-204b-4850-b62b-6e548456f096"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:25.631520 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Getting quotas for project 753d5874ae814841af6314a4db696221. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:05:25.637169 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Getting quotas for user 1fd15df599fa4261b917f4f9b1d1f75a and project 753d5874ae814841af6314a4db696221. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:05:25.650616 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:05:25.652911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:05:25.697555 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] validate_networks() for [('498c549c-204b-4850-b62b-6e548456f096', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:05:25.704782 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1620e16e-fc51-44e9-9911-404d4bd2068e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.517881 Jul 04 08:05:25.706123 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 79/158] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:05:25.720510 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0b672706-7a95-4cf2-b133-4f472da59215 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:25.721337 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0b672706-7a95-4cf2-b133-4f472da59215 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:25.803672 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0b672706-7a95-4cf2-b133-4f472da59215 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:25.812387 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0b672706-7a95-4cf2-b133-4f472da59215 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1215 microversion: 2.1 time: 0.097914 Jul 04 08:05:25.813129 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 80/159] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:25 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1215 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:25.866973 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d47aced7-ea85-4d24-b7ca-0b82a50edafd tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:25.869470 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d47aced7-ea85-4d24-b7ca-0b82a50edafd tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:25.892427 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d47aced7-ea85-4d24-b7ca-0b82a50edafd tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:25.893273 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d47aced7-ea85-4d24-b7ca-0b82a50edafd tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:25.894322 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d47aced7-ea85-4d24-b7ca-0b82a50edafd tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:25.894978 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d47aced7-ea85-4d24-b7ca-0b82a50edafd tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:26.112793 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d47aced7-ea85-4d24-b7ca-0b82a50edafd tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:26.125151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d47aced7-ea85-4d24-b7ca-0b82a50edafd tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.272199 Jul 04 08:05:26.135858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 81/160] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:25 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:26.333769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f011a3ff-ef6a-44d3-a43f-e4e7b906a616 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eda3d10e-ebd8-4764-8681-0e5675e3ccc6"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:26.335543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f011a3ff-ef6a-44d3-a43f-e4e7b906a616 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:26.348509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f011a3ff-ef6a-44d3-a43f-e4e7b906a616 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:26.349566 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f011a3ff-ef6a-44d3-a43f-e4e7b906a616 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:26.353574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f011a3ff-ef6a-44d3-a43f-e4e7b906a616 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:26.354205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f011a3ff-ef6a-44d3-a43f-e4e7b906a616 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:26.810517 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f011a3ff-ef6a-44d3-a43f-e4e7b906a616 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481304 Jul 04 08:05:26.811295 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 82/161] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:05:26 2022] POST /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:05:26.820956 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e0008dc7-d1a6-44b6-b00e-865075316dda tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:26.821645 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e0008dc7-d1a6-44b6-b00e-865075316dda tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:26.828763 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e0008dc7-d1a6-44b6-b00e-865075316dda tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:26.829658 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e0008dc7-d1a6-44b6-b00e-865075316dda tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:26.830424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e0008dc7-d1a6-44b6-b00e-865075316dda tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:26.830847 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e0008dc7-d1a6-44b6-b00e-865075316dda tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:26.855614 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e0008dc7-d1a6-44b6-b00e-865075316dda tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/ips" status: 200 len: 153 microversion: 2.20 time: 0.043040 Jul 04 08:05:26.856211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 83/162] 10.222.0.43 () {60 vars in 1288 bytes} [Mon Jul 4 08:05:26 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/ips => generated 153 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 08:05:26.860817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-67825eee-e7d6-45de-8bd3-dda26dc34a1a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:26.862185 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-67825eee-e7d6-45de-8bd3-dda26dc34a1a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:26.869296 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67825eee-e7d6-45de-8bd3-dda26dc34a1a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:26.869762 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67825eee-e7d6-45de-8bd3-dda26dc34a1a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:26.870788 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67825eee-e7d6-45de-8bd3-dda26dc34a1a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:26.871200 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67825eee-e7d6-45de-8bd3-dda26dc34a1a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:26.965429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67825eee-e7d6-45de-8bd3-dda26dc34a1a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:26.973902 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-67825eee-e7d6-45de-8bd3-dda26dc34a1a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1267 microversion: 2.1 time: 0.116523 Jul 04 08:05:26.974509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 84/163] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:26 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1267 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:27.123688 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:05:27.136888 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:05:27.137549 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:05:27.143230 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:05:27.144072 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:05:27.145804 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-488d97ac-6648-4d59-bba2-2bd0479e0731 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:27.146915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-488d97ac-6648-4d59-bba2-2bd0479e0731 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:27.161934 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-488d97ac-6648-4d59-bba2-2bd0479e0731 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:27.162800 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-488d97ac-6648-4d59-bba2-2bd0479e0731 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:27.165319 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-488d97ac-6648-4d59-bba2-2bd0479e0731 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:27.165971 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-488d97ac-6648-4d59-bba2-2bd0479e0731 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:27.171093 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:27.172047 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:27.173213 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:27.173659 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:27.223866 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Getting quotas for project 6de1b2d9c55f4af7b6793ac472a6d408. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:05:27.231493 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Getting quotas for user 34b2b4070d344d7ca07a99985678467a and project 6de1b2d9c55f4af7b6793ac472a6d408. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:05:27.269294 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:05:27.279314 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:05:27.365561 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c72c8199-71d4-479a-b88e-3600718eff50 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.743859 Jul 04 08:05:27.366253 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 80/164] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:05:27.379102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-01f16af6-2aeb-4357-ae39-b20cfa0bedfb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:27.385512 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-01f16af6-2aeb-4357-ae39-b20cfa0bedfb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:27.458928 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-01f16af6-2aeb-4357-ae39-b20cfa0bedfb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:27.465158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-488d97ac-6648-4d59-bba2-2bd0479e0731 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:27.471232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-01f16af6-2aeb-4357-ae39-b20cfa0bedfb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1218 microversion: 2.1 time: 0.097917 Jul 04 08:05:27.471832 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 81/165] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:27 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:27.476924 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-58a3b998-e86d-42c9-8460-72cae134dcc5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "250c4d62-8b01-4a0c-8869-7d5e60c28437"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:27.478490 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-58a3b998-e86d-42c9-8460-72cae134dcc5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:27.480374 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-488d97ac-6648-4d59-bba2-2bd0479e0731 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.340994 Jul 04 08:05:27.481188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 85/166] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:27 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:27.486532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58a3b998-e86d-42c9-8460-72cae134dcc5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:27.486986 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58a3b998-e86d-42c9-8460-72cae134dcc5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:27.487762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58a3b998-e86d-42c9-8460-72cae134dcc5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:27.488194 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58a3b998-e86d-42c9-8460-72cae134dcc5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:27.994486 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cb93f290-1170-4934-970e-5436a56468ab tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:27.995631 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cb93f290-1170-4934-970e-5436a56468ab tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:28.007574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb93f290-1170-4934-970e-5436a56468ab tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:28.008017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb93f290-1170-4934-970e-5436a56468ab tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:28.008797 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb93f290-1170-4934-970e-5436a56468ab tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:28.009274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb93f290-1170-4934-970e-5436a56468ab tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:28.074651 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cb93f290-1170-4934-970e-5436a56468ab tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:28.084422 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cb93f290-1170-4934-970e-5436a56468ab tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1275 microversion: 2.1 time: 0.096503 Jul 04 08:05:28.085020 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 86/167] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:27 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1275 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:28.490157 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-79bbeced-e785-41fe-8058-c5f64172fd47 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:28.491544 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-79bbeced-e785-41fe-8058-c5f64172fd47 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:28.520591 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79bbeced-e785-41fe-8058-c5f64172fd47 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:28.522904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79bbeced-e785-41fe-8058-c5f64172fd47 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:28.525990 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79bbeced-e785-41fe-8058-c5f64172fd47 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:28.527836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79bbeced-e785-41fe-8058-c5f64172fd47 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:28.654438 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-79bbeced-e785-41fe-8058-c5f64172fd47 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:28.693798 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-79bbeced-e785-41fe-8058-c5f64172fd47 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1222 microversion: 2.1 time: 0.205211 Jul 04 08:05:28.706574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 87/168] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:28 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1222 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:28.738277 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9f6b799a-1ecc-47b3-ac65-2b10a935086d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:28.738862 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9f6b799a-1ecc-47b3-ac65-2b10a935086d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:28.754456 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f6b799a-1ecc-47b3-ac65-2b10a935086d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:28.754919 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f6b799a-1ecc-47b3-ac65-2b10a935086d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:28.755758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f6b799a-1ecc-47b3-ac65-2b10a935086d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:28.756188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f6b799a-1ecc-47b3-ac65-2b10a935086d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:28.762525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-58a3b998-e86d-42c9-8460-72cae134dcc5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.289132 Jul 04 08:05:28.769487 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 82/169] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:05:27 2022] POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/os-volume_attachments => generated 194 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:29.009222 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9f6b799a-1ecc-47b3-ac65-2b10a935086d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:29.019441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9f6b799a-1ecc-47b3-ac65-2b10a935086d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.291878 Jul 04 08:05:29.029666 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 88/170] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:28 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:29.106198 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a4cc0191-bb42-49c4-9200-4bd4b943e000 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:29.107221 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a4cc0191-bb42-49c4-9200-4bd4b943e000 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:29.119344 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4cc0191-bb42-49c4-9200-4bd4b943e000 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:29.120043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4cc0191-bb42-49c4-9200-4bd4b943e000 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:29.126253 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4cc0191-bb42-49c4-9200-4bd4b943e000 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:29.128142 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4cc0191-bb42-49c4-9200-4bd4b943e000 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:29.206580 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a4cc0191-bb42-49c4-9200-4bd4b943e000 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:29.218614 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a4cc0191-bb42-49c4-9200-4bd4b943e000 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1273 microversion: 2.1 time: 0.118877 Jul 04 08:05:29.219352 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 83/171] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:29 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1273 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:29.733975 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-74d3039d-9e5a-4721-b34b-a4ac6a3532dc tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:29.734792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-74d3039d-9e5a-4721-b34b-a4ac6a3532dc tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:29.749848 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74d3039d-9e5a-4721-b34b-a4ac6a3532dc tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:29.753761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74d3039d-9e5a-4721-b34b-a4ac6a3532dc tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:29.753761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74d3039d-9e5a-4721-b34b-a4ac6a3532dc tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:29.753761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74d3039d-9e5a-4721-b34b-a4ac6a3532dc tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:29.828731 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-74d3039d-9e5a-4721-b34b-a4ac6a3532dc tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:29.841314 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-74d3039d-9e5a-4721-b34b-a4ac6a3532dc tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1276 microversion: 2.1 time: 0.112681 Jul 04 08:05:29.842740 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 89/172] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:29 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:29.879563 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9b131072-afb6-4ca4-bd74-afb834b5ca51 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:29.880421 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9b131072-afb6-4ca4-bd74-afb834b5ca51 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:29.889133 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9b131072-afb6-4ca4-bd74-afb834b5ca51 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:29.889907 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9b131072-afb6-4ca4-bd74-afb834b5ca51 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:29.890804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9b131072-afb6-4ca4-bd74-afb834b5ca51 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:29.891252 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9b131072-afb6-4ca4-bd74-afb834b5ca51 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:29.928409 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-9b131072-afb6-4ca4-bd74-afb834b5ca51 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lazy-loading 'flavor' on Instance uuid a42c331b-8c2a-4f37-bd0a-7221b07bf3af {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:05:30.043740 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-23121f5d-32e4-495c-abcd-d15c8dee204e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:30.044858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-23121f5d-32e4-495c-abcd-d15c8dee204e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:30.052764 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23121f5d-32e4-495c-abcd-d15c8dee204e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:30.053192 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23121f5d-32e4-495c-abcd-d15c8dee204e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:30.054215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23121f5d-32e4-495c-abcd-d15c8dee204e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:30.054812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23121f5d-32e4-495c-abcd-d15c8dee204e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:30.214247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-23121f5d-32e4-495c-abcd-d15c8dee204e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:30.223335 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-23121f5d-32e4-495c-abcd-d15c8dee204e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.184458 Jul 04 08:05:30.224050 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 90/173] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:30 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:30.239006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-53ef0d59-021e-47db-a880-bd2f7ca00e79 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:30.239614 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-53ef0d59-021e-47db-a880-bd2f7ca00e79 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:30.247671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53ef0d59-021e-47db-a880-bd2f7ca00e79 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:30.248395 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53ef0d59-021e-47db-a880-bd2f7ca00e79 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:30.249973 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53ef0d59-021e-47db-a880-bd2f7ca00e79 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:30.249973 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53ef0d59-021e-47db-a880-bd2f7ca00e79 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:30.345876 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-53ef0d59-021e-47db-a880-bd2f7ca00e79 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:30.351365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9b131072-afb6-4ca4-bd74-afb834b5ca51 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/action" status: 202 len: 0 microversion: 2.20 time: 0.477620 Jul 04 08:05:30.352550 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 84/174] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Jul 4 08:05:29 2022] POST /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:05:30.360582 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-53ef0d59-021e-47db-a880-bd2f7ca00e79 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1273 microversion: 2.1 time: 0.126446 Jul 04 08:05:30.367910 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:30.369556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:30.380250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 91/175] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:30 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:30.388244 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:30.389497 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:30.390993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:30.391800 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:30.792979 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-65fdc1b5-075c-4312-b9bb-18af3481450a req-5c954a5a-9443-4dc6-b303-c2e69e3827b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d58cef-2712-485a-a46d-b96178458181", "name": "network-vif-plugged", "status": "completed", "tag": "bc0b4523-5b60-4757-aa81-8ac852d68a9d"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:30.809133 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-65fdc1b5-075c-4312-b9bb-18af3481450a req-5c954a5a-9443-4dc6-b303-c2e69e3827b6 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:30.810617 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-65fdc1b5-075c-4312-b9bb-18af3481450a req-5c954a5a-9443-4dc6-b303-c2e69e3827b6 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:30.816215 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:30.826068 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:30.828136 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:30.829742 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-88129ceb-12de-49eb-81d5-0f288ba94223 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.470141 Jul 04 08:05:30.841555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-65fdc1b5-075c-4312-b9bb-18af3481450a req-5c954a5a-9443-4dc6-b303-c2e69e3827b6 service nova] Creating event network-vif-plugged:bc0b4523-5b60-4757-aa81-8ac852d68a9d for instance 07d58cef-2712-485a-a46d-b96178458181 on hv-cinder-79760 Jul 04 08:05:30.841900 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 85/176] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:30 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:30.851492 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-65fdc1b5-075c-4312-b9bb-18af3481450a req-5c954a5a-9443-4dc6-b303-c2e69e3827b6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064270 Jul 04 08:05:30.852554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 92/177] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:30.865546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-50dacd4e-39fc-44f1-8b60-5073a0913905 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:30.866669 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-50dacd4e-39fc-44f1-8b60-5073a0913905 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:30.875079 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-50dacd4e-39fc-44f1-8b60-5073a0913905 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:30.875751 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-50dacd4e-39fc-44f1-8b60-5073a0913905 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:30.877889 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-50dacd4e-39fc-44f1-8b60-5073a0913905 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:30.878711 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-50dacd4e-39fc-44f1-8b60-5073a0913905 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:31.001251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-50dacd4e-39fc-44f1-8b60-5073a0913905 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:31.017480 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-50dacd4e-39fc-44f1-8b60-5073a0913905 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1276 microversion: 2.1 time: 0.154985 Jul 04 08:05:31.018920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 86/178] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:30 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:31.250218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b7a72746-60d7-4682-9c3c-51370efc10ff tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:31.253781 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b7a72746-60d7-4682-9c3c-51370efc10ff tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:31.265074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7a72746-60d7-4682-9c3c-51370efc10ff tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:31.265810 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7a72746-60d7-4682-9c3c-51370efc10ff tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:31.267539 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7a72746-60d7-4682-9c3c-51370efc10ff tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:31.269497 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7a72746-60d7-4682-9c3c-51370efc10ff tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:31.385709 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0bad41e4-cd02-475c-9bad-605c14084b41 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:31.386737 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0bad41e4-cd02-475c-9bad-605c14084b41 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:31.395029 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0bad41e4-cd02-475c-9bad-605c14084b41 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:31.395786 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0bad41e4-cd02-475c-9bad-605c14084b41 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:31.396551 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0bad41e4-cd02-475c-9bad-605c14084b41 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:31.397143 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0bad41e4-cd02-475c-9bad-605c14084b41 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:31.435339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b7a72746-60d7-4682-9c3c-51370efc10ff tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:31.440282 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:31.445706 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b7a72746-60d7-4682-9c3c-51370efc10ff tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.204856 Jul 04 08:05:31.446400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 93/179] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:31 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:31.684465 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0bad41e4-cd02-475c-9bad-605c14084b41 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:31.695745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0bad41e4-cd02-475c-9bad-605c14084b41 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.313765 Jul 04 08:05:31.697446 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 87/180] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:31 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:31.849326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:31.849875 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:31.857773 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:31.858222 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:31.859312 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:31.859823 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:32.026022 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:32.035478 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d4247cde-d394-4167-8c41-fae1aa217630 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:32.036312 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d4247cde-d394-4167-8c41-fae1aa217630 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:32.041710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:32.044038 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d4247cde-d394-4167-8c41-fae1aa217630 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:32.044237 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:32.045030 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d4247cde-d394-4167-8c41-fae1aa217630 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:32.045967 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d4247cde-d394-4167-8c41-fae1aa217630 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:32.046089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d90df00f-9336-449f-beae-90ddd6fee26f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.201066 Jul 04 08:05:32.046675 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d4247cde-d394-4167-8c41-fae1aa217630 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:32.046854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 94/181] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:31 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:32.360528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d4247cde-d394-4167-8c41-fae1aa217630 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:32.370787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d4247cde-d394-4167-8c41-fae1aa217630 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1318 microversion: 2.1 time: 0.339160 Jul 04 08:05:32.371890 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 88/182] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:32 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:32.465024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9f82dd20-1a43-4368-9620-c2b809e233cf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:32.466299 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9f82dd20-1a43-4368-9620-c2b809e233cf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:32.482038 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f82dd20-1a43-4368-9620-c2b809e233cf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:32.482505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f82dd20-1a43-4368-9620-c2b809e233cf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:32.483756 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f82dd20-1a43-4368-9620-c2b809e233cf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:32.484480 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f82dd20-1a43-4368-9620-c2b809e233cf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:32.683436 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9f82dd20-1a43-4368-9620-c2b809e233cf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:32.699205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9f82dd20-1a43-4368-9620-c2b809e233cf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.238384 Jul 04 08:05:32.700782 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 95/183] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:32 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:32.717991 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-45c7a85c-aaad-4572-a64f-b16d110dd34a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:32.718988 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-45c7a85c-aaad-4572-a64f-b16d110dd34a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:32.726482 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-45c7a85c-aaad-4572-a64f-b16d110dd34a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:32.727178 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-45c7a85c-aaad-4572-a64f-b16d110dd34a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:32.728060 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-45c7a85c-aaad-4572-a64f-b16d110dd34a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:32.728581 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-45c7a85c-aaad-4572-a64f-b16d110dd34a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:32.895144 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-a1820eca-0f02-450d-b9e6-8e128fbb0a23 req-ceceeb80-6208-468c-a570-df930d538a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d165c5-1758-4475-b335-7eb6f12f7d3c", "name": "network-vif-plugged", "status": "completed", "tag": "e31114ef-5009-42b7-86f6-1482f88fd705"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:32.912585 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-a1820eca-0f02-450d-b9e6-8e128fbb0a23 req-ceceeb80-6208-468c-a570-df930d538a7f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:32.913170 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-a1820eca-0f02-450d-b9e6-8e128fbb0a23 req-ceceeb80-6208-468c-a570-df930d538a7f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:32.929063 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-a1820eca-0f02-450d-b9e6-8e128fbb0a23 req-ceceeb80-6208-468c-a570-df930d538a7f service nova] Creating event network-vif-plugged:e31114ef-5009-42b7-86f6-1482f88fd705 for instance c5d165c5-1758-4475-b335-7eb6f12f7d3c on hv-cinder-79760 Jul 04 08:05:32.934628 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-a1820eca-0f02-450d-b9e6-8e128fbb0a23 req-ceceeb80-6208-468c-a570-df930d538a7f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043963 Jul 04 08:05:32.935428 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 96/184] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:33.033306 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-197786e6-7352-4b1e-a80c-6dbe039ab568 req-6c6b3ce9-883d-4418-9a81-ea76cb8238eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a67c0a90-28f0-44b7-9c91-d25c02ce9928", "tag": "197c6bcb-bf0d-428c-b74d-952bae34c47e"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:33.046604 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-197786e6-7352-4b1e-a80c-6dbe039ab568 req-6c6b3ce9-883d-4418-9a81-ea76cb8238eb service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:33.047128 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-197786e6-7352-4b1e-a80c-6dbe039ab568 req-6c6b3ce9-883d-4418-9a81-ea76cb8238eb service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:33.060615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-197786e6-7352-4b1e-a80c-6dbe039ab568 req-6c6b3ce9-883d-4418-9a81-ea76cb8238eb service nova] Creating event network-changed:197c6bcb-bf0d-428c-b74d-952bae34c47e for instance a67c0a90-28f0-44b7-9c91-d25c02ce9928 on hv-cinder-79760 Jul 04 08:05:33.066419 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-197786e6-7352-4b1e-a80c-6dbe039ab568 req-6c6b3ce9-883d-4418-9a81-ea76cb8238eb service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037515 Jul 04 08:05:33.067052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 97/185] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:33.072850 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:33.073768 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:33.085159 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-45c7a85c-aaad-4572-a64f-b16d110dd34a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:33.090033 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:33.090558 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:33.091399 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:33.097489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-45c7a85c-aaad-4572-a64f-b16d110dd34a tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.384475 Jul 04 08:05:33.099090 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:33.104057 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 89/186] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:32 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:33.352734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:33.363815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:33.365950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:33.367508 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-728b0e3c-bd70-4a94-bfb7-e464ff60cd0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.299137 Jul 04 08:05:33.379884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 98/187] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:33 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:33.388847 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-335317d3-4d54-486b-82c4-a807e6435e21 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:33.389813 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-335317d3-4d54-486b-82c4-a807e6435e21 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:33.398060 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-335317d3-4d54-486b-82c4-a807e6435e21 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:33.399034 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-335317d3-4d54-486b-82c4-a807e6435e21 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:33.400087 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-335317d3-4d54-486b-82c4-a807e6435e21 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:33.401242 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-335317d3-4d54-486b-82c4-a807e6435e21 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:33.429869 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:33.716810 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-20948997-ec27-44d0-81ba-e3339a9c1477 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:33.717531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-20948997-ec27-44d0-81ba-e3339a9c1477 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:33.724860 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20948997-ec27-44d0-81ba-e3339a9c1477 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:33.725410 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20948997-ec27-44d0-81ba-e3339a9c1477 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:33.726286 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20948997-ec27-44d0-81ba-e3339a9c1477 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:33.726786 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20948997-ec27-44d0-81ba-e3339a9c1477 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:33.805773 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-335317d3-4d54-486b-82c4-a807e6435e21 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:33.814257 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-335317d3-4d54-486b-82c4-a807e6435e21 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1318 microversion: 2.1 time: 0.429259 Jul 04 08:05:33.816576 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 90/188] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:33 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:33.901954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-20948997-ec27-44d0-81ba-e3339a9c1477 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:33.911158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-20948997-ec27-44d0-81ba-e3339a9c1477 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.198268 Jul 04 08:05:33.911774 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 99/189] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:33 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:34.121545 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-befc7c05-267a-479d-91fe-928be90428d0 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:34.122981 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-befc7c05-267a-479d-91fe-928be90428d0 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:34.132392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-befc7c05-267a-479d-91fe-928be90428d0 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:34.132899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-befc7c05-267a-479d-91fe-928be90428d0 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:34.133847 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-befc7c05-267a-479d-91fe-928be90428d0 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:34.134437 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-befc7c05-267a-479d-91fe-928be90428d0 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:34.366815 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-befc7c05-267a-479d-91fe-928be90428d0 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:34.384853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-befc7c05-267a-479d-91fe-928be90428d0 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.266627 Jul 04 08:05:34.386800 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 91/190] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:34 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:34.399085 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:34.401297 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:34.410193 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:34.410975 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:34.411883 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:34.412482 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:34.589009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:34.604316 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:34.607488 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:34.609788 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5a2fe807-2691-4c32-8900-46e29b32f2d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.224909 Jul 04 08:05:34.617726 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 100/191] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:34 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:05:34.846117 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-31152740-94a5-4910-be93-ce7e9f55bf25 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:34.847223 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-31152740-94a5-4910-be93-ce7e9f55bf25 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:34.858049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31152740-94a5-4910-be93-ce7e9f55bf25 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:34.858615 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31152740-94a5-4910-be93-ce7e9f55bf25 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:34.859690 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31152740-94a5-4910-be93-ce7e9f55bf25 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:34.860192 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-31152740-94a5-4910-be93-ce7e9f55bf25 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:34.935267 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-db8232af-daba-4b07-8399-38c64b8fe303 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:34.936317 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-db8232af-daba-4b07-8399-38c64b8fe303 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:34.947880 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db8232af-daba-4b07-8399-38c64b8fe303 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:34.948523 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db8232af-daba-4b07-8399-38c64b8fe303 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:34.949915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db8232af-daba-4b07-8399-38c64b8fe303 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:34.950611 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db8232af-daba-4b07-8399-38c64b8fe303 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:35.139261 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-db8232af-daba-4b07-8399-38c64b8fe303 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:35.147944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-db8232af-daba-4b07-8399-38c64b8fe303 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1322 microversion: 2.1 time: 0.220865 Jul 04 08:05:35.148550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 101/192] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:34 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:35.154280 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-f534806d-973e-41fa-be7c-8e5da9e2667d req-e17256a3-b9b4-4e1b-89b5-59b5cdd777c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c989c0-8d21-40d1-bc9d-9d5010bc6378", "tag": "73d4fae8-2faf-42dd-99fc-e6b6beee5ee6"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:35.163707 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f534806d-973e-41fa-be7c-8e5da9e2667d req-e17256a3-b9b4-4e1b-89b5-59b5cdd777c4 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:35.164247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f534806d-973e-41fa-be7c-8e5da9e2667d req-e17256a3-b9b4-4e1b-89b5-59b5cdd777c4 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:35.176825 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-f534806d-973e-41fa-be7c-8e5da9e2667d req-e17256a3-b9b4-4e1b-89b5-59b5cdd777c4 service nova] Creating event network-changed:73d4fae8-2faf-42dd-99fc-e6b6beee5ee6 for instance 25c989c0-8d21-40d1-bc9d-9d5010bc6378 on hv-cinder-79760 Jul 04 08:05:35.181883 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-f534806d-973e-41fa-be7c-8e5da9e2667d req-e17256a3-b9b4-4e1b-89b5-59b5cdd777c4 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031895 Jul 04 08:05:35.182615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 102/193] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:35.196982 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-31152740-94a5-4910-be93-ce7e9f55bf25 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:35.206008 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-31152740-94a5-4910-be93-ce7e9f55bf25 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1318 microversion: 2.1 time: 0.366658 Jul 04 08:05:35.206621 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 92/194] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:34 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:35.418127 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e61d4661-123a-459b-be07-d4919534f058 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:35.419502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e61d4661-123a-459b-be07-d4919534f058 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:35.438403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e61d4661-123a-459b-be07-d4919534f058 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:35.439717 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e61d4661-123a-459b-be07-d4919534f058 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:35.442637 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e61d4661-123a-459b-be07-d4919534f058 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:35.444097 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e61d4661-123a-459b-be07-d4919534f058 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:35.620033 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:35.630651 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:35.631123 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:35.638116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:35.638802 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:35.639812 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:35.640613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:35.672043 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e61d4661-123a-459b-be07-d4919534f058 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:35.682440 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e61d4661-123a-459b-be07-d4919534f058 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.273529 Jul 04 08:05:35.694224 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 103/195] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:35 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:35.833595 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:35.846466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:35.849101 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:35.850827 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a654cbad-6743-4d2c-9c5f-0dcd3a66e3fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.224449 Jul 04 08:05:35.851630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 93/196] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:35 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:36.166786 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-052c6606-fbca-42ce-a768-6ee6b1b41409 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:36.167412 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-052c6606-fbca-42ce-a768-6ee6b1b41409 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:36.169358 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=12 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:36.176481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052c6606-fbca-42ce-a768-6ee6b1b41409 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.176935 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052c6606-fbca-42ce-a768-6ee6b1b41409 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.177780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052c6606-fbca-42ce-a768-6ee6b1b41409 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.178211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052c6606-fbca-42ce-a768-6ee6b1b41409 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.231827 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-33993833-ff1b-4502-94bf-b77dfaff1ba3 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:36.233252 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-33993833-ff1b-4502-94bf-b77dfaff1ba3 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:36.246255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33993833-ff1b-4502-94bf-b77dfaff1ba3 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.247064 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33993833-ff1b-4502-94bf-b77dfaff1ba3 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.248439 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33993833-ff1b-4502-94bf-b77dfaff1ba3 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.249192 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33993833-ff1b-4502-94bf-b77dfaff1ba3 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.339452 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-052c6606-fbca-42ce-a768-6ee6b1b41409 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:36.353090 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-052c6606-fbca-42ce-a768-6ee6b1b41409 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1516 microversion: 2.1 time: 0.189898 Jul 04 08:05:36.354945 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 104/197] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:36 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:36.375592 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7e7cec72-0da7-42f9-8382-f52f3d30b3f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:36.376853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7e7cec72-0da7-42f9-8382-f52f3d30b3f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:36.384081 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e7cec72-0da7-42f9-8382-f52f3d30b3f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.384616 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e7cec72-0da7-42f9-8382-f52f3d30b3f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.385453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e7cec72-0da7-42f9-8382-f52f3d30b3f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.385973 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e7cec72-0da7-42f9-8382-f52f3d30b3f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.410547 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-7e7cec72-0da7-42f9-8382-f52f3d30b3f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'flavor' on Instance uuid c5d165c5-1758-4475-b335-7eb6f12f7d3c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:05:36.438235 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-33993833-ff1b-4502-94bf-b77dfaff1ba3 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:36.449377 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-33993833-ff1b-4502-94bf-b77dfaff1ba3 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1318 microversion: 2.1 time: 0.224066 Jul 04 08:05:36.450142 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 94/198] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:36 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:36.569012 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7e7cec72-0da7-42f9-8382-f52f3d30b3f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c/action" status: 200 len: 32 microversion: 2.1 time: 0.197180 Jul 04 08:05:36.570169 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 105/199] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:05:36 2022] POST /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 08:05:36.581203 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1080c7cd-df83-4146-8426-d2eb52e1a71f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:36.582102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1080c7cd-df83-4146-8426-d2eb52e1a71f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:36.590449 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1080c7cd-df83-4146-8426-d2eb52e1a71f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.590949 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1080c7cd-df83-4146-8426-d2eb52e1a71f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.592017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1080c7cd-df83-4146-8426-d2eb52e1a71f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.592682 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1080c7cd-df83-4146-8426-d2eb52e1a71f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.714331 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-871573d4-dcbf-40c0-b52c-ee78006e09e9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:36.715718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-871573d4-dcbf-40c0-b52c-ee78006e09e9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:36.727521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-871573d4-dcbf-40c0-b52c-ee78006e09e9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.728426 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-871573d4-dcbf-40c0-b52c-ee78006e09e9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.730221 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-871573d4-dcbf-40c0-b52c-ee78006e09e9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.731003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-871573d4-dcbf-40c0-b52c-ee78006e09e9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.783670 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1080c7cd-df83-4146-8426-d2eb52e1a71f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:36.795810 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1080c7cd-df83-4146-8426-d2eb52e1a71f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.219221 Jul 04 08:05:36.796673 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 95/200] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:36 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:36.874115 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:36.874855 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:36.884348 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.885119 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.886510 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:36.887417 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:36.962809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-871573d4-dcbf-40c0-b52c-ee78006e09e9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:36.972765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-871573d4-dcbf-40c0-b52c-ee78006e09e9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.266422 Jul 04 08:05:36.973372 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 106/201] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:36 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:37.187649 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:37.208577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:37.217366 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:37.219000 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:37.220506 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-882f18e7-5489-439c-82be-7fbf1eda9874 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.352345 Jul 04 08:05:37.221108 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 96/202] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:36 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:05:37.479455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-019a34cf-3079-422a-9ce0-13538fa9086c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:37.480557 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-019a34cf-3079-422a-9ce0-13538fa9086c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:37.492851 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-019a34cf-3079-422a-9ce0-13538fa9086c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:37.493650 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-019a34cf-3079-422a-9ce0-13538fa9086c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:37.495046 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-019a34cf-3079-422a-9ce0-13538fa9086c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:37.495803 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-019a34cf-3079-422a-9ce0-13538fa9086c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:37.688643 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-019a34cf-3079-422a-9ce0-13538fa9086c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:37.703271 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-019a34cf-3079-422a-9ce0-13538fa9086c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1318 microversion: 2.1 time: 0.229679 Jul 04 08:05:37.704348 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 107/203] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:37 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:37.820404 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-57a24b41-b725-4342-8427-be0147908dd5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:37.821006 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-57a24b41-b725-4342-8427-be0147908dd5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:37.823616 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=20 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:37.829385 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57a24b41-b725-4342-8427-be0147908dd5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:37.829910 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57a24b41-b725-4342-8427-be0147908dd5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:37.830932 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57a24b41-b725-4342-8427-be0147908dd5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:37.831367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-57a24b41-b725-4342-8427-be0147908dd5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:37.985907 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-57a24b41-b725-4342-8427-be0147908dd5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:37.994477 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-57a24b41-b725-4342-8427-be0147908dd5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.178283 Jul 04 08:05:37.995095 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 97/204] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:37 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:38.000805 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-14183000-b20f-4b63-926e-0222f7f4bb84 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:38.001493 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-14183000-b20f-4b63-926e-0222f7f4bb84 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:38.008980 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-14183000-b20f-4b63-926e-0222f7f4bb84 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:38.009429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-14183000-b20f-4b63-926e-0222f7f4bb84 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:38.010369 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-14183000-b20f-4b63-926e-0222f7f4bb84 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:38.010829 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-14183000-b20f-4b63-926e-0222f7f4bb84 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:38.187649 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-14183000-b20f-4b63-926e-0222f7f4bb84 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:38.199344 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-14183000-b20f-4b63-926e-0222f7f4bb84 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.205128 Jul 04 08:05:38.200195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 108/205] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:37 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:38.244955 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:38.246072 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:38.259307 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:38.260436 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:38.262204 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:38.265292 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:38.696970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:38.718636 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:38.727591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:38.728870 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-23a09f6f-abec-4afe-ab75-d57367a2549a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:38.729670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-23a09f6f-abec-4afe-ab75-d57367a2549a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:38.734952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cc475b39-e76a-4dad-924a-27b44a976319 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.494909 Jul 04 08:05:38.750855 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 98/206] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:38 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:38.751511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23a09f6f-abec-4afe-ab75-d57367a2549a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:38.752484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23a09f6f-abec-4afe-ab75-d57367a2549a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:38.753513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23a09f6f-abec-4afe-ab75-d57367a2549a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:38.753989 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23a09f6f-abec-4afe-ab75-d57367a2549a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:38.929742 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-23a09f6f-abec-4afe-ab75-d57367a2549a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:38.940586 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-23a09f6f-abec-4afe-ab75-d57367a2549a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1318 microversion: 2.1 time: 0.215729 Jul 04 08:05:38.941566 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 109/207] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:38 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:38.963845 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1212a4f6-1590-4a6c-a8d7-4add95637111 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: .version_select at 0x7f05e58ada60>, body: {"keypair": {"name": "tempest-keypair-567698803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUmUxWpNCdK7ilTVUQGJ3MZk3PyAITvGNscBUKpBHf+WiHpYtek4ReYoRM8VINP4wv7LUAfNsOGm7fUCDTbtMwuNf3s8qo1AIbRe/a7dFHKI/qieHFA9WVXztKak+4M9w=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:38.974799 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:38.983219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-1212a4f6-1590-4a6c-a8d7-4add95637111 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for project de5226d001fb47b399172b6633fec844. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:05:38.988574 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-1212a4f6-1590-4a6c-a8d7-4add95637111 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for user 126ba607541e4c4895b47b4b7602ce01 and project de5226d001fb47b399172b6633fec844. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:05:39.016817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-63ce7717-22ca-483c-bf85-7ae86cb38e21 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:39.017028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1212a4f6-1590-4a6c-a8d7-4add95637111 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057290 Jul 04 08:05:39.017896 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-63ce7717-22ca-483c-bf85-7ae86cb38e21 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:39.018062 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 99/208] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:05:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:39.026575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63ce7717-22ca-483c-bf85-7ae86cb38e21 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:39.027151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63ce7717-22ca-483c-bf85-7ae86cb38e21 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:39.028103 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63ce7717-22ca-483c-bf85-7ae86cb38e21 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:39.028619 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63ce7717-22ca-483c-bf85-7ae86cb38e21 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:39.050645 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:39.230686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2d172352-d4ca-4d76-9fff-0e5d1b45b8b9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:39.231714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2d172352-d4ca-4d76-9fff-0e5d1b45b8b9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:39.245173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d172352-d4ca-4d76-9fff-0e5d1b45b8b9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:39.245660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d172352-d4ca-4d76-9fff-0e5d1b45b8b9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:39.246466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d172352-d4ca-4d76-9fff-0e5d1b45b8b9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:39.247517 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d172352-d4ca-4d76-9fff-0e5d1b45b8b9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:39.290985 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-63ce7717-22ca-483c-bf85-7ae86cb38e21 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:39.304876 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-63ce7717-22ca-483c-bf85-7ae86cb38e21 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.293559 Jul 04 08:05:39.306203 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 110/209] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:39 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:39.560660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2d172352-d4ca-4d76-9fff-0e5d1b45b8b9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:39.570123 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2d172352-d4ca-4d76-9fff-0e5d1b45b8b9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.347488 Jul 04 08:05:39.571169 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 100/210] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:39 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:39.759962 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:39.761257 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:39.775309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:39.776049 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:39.777330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:39.778431 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:39.961525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-af3f45f4-5460-4cca-b990-aba9d53cdbbb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:39.962486 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-af3f45f4-5460-4cca-b990-aba9d53cdbbb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:39.972323 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af3f45f4-5460-4cca-b990-aba9d53cdbbb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:39.973366 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af3f45f4-5460-4cca-b990-aba9d53cdbbb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:39.975175 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af3f45f4-5460-4cca-b990-aba9d53cdbbb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:39.975672 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-af3f45f4-5460-4cca-b990-aba9d53cdbbb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:40.033097 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:40.053829 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:40.056590 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:40.058754 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-23c51a3d-7b91-4be5-915b-a2911e53abcb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.305532 Jul 04 08:05:40.059841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 111/211] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:39 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:40.329949 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0e00f82c-44d3-4cd6-842f-a8f1b87edfc9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:40.331003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0e00f82c-44d3-4cd6-842f-a8f1b87edfc9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:40.337531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:40.339060 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-af3f45f4-5460-4cca-b990-aba9d53cdbbb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:40.344925 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e00f82c-44d3-4cd6-842f-a8f1b87edfc9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:40.345667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e00f82c-44d3-4cd6-842f-a8f1b87edfc9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:40.347664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e00f82c-44d3-4cd6-842f-a8f1b87edfc9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:40.348400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e00f82c-44d3-4cd6-842f-a8f1b87edfc9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:40.352051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-af3f45f4-5460-4cca-b990-aba9d53cdbbb tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1318 microversion: 2.1 time: 0.396745 Jul 04 08:05:40.352638 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 101/212] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:39 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:40.573640 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0e00f82c-44d3-4cd6-842f-a8f1b87edfc9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:40.587604 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0e00f82c-44d3-4cd6-842f-a8f1b87edfc9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.263526 Jul 04 08:05:40.588370 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 112/213] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:40 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:40.589154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-714a4b30-3734-4453-81a2-8c9da8d5d5e2 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:40.590185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-714a4b30-3734-4453-81a2-8c9da8d5d5e2 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:40.598174 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-714a4b30-3734-4453-81a2-8c9da8d5d5e2 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:40.599297 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-714a4b30-3734-4453-81a2-8c9da8d5d5e2 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:40.600690 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-714a4b30-3734-4453-81a2-8c9da8d5d5e2 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:40.601019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-714a4b30-3734-4453-81a2-8c9da8d5d5e2 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:40.955226 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-714a4b30-3734-4453-81a2-8c9da8d5d5e2 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:40.966375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-714a4b30-3734-4453-81a2-8c9da8d5d5e2 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.381117 Jul 04 08:05:40.966960 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 102/214] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:40 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:41.061074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-f8c2c34b-1eaf-46c2-ab10-71be33fd21d8 req-8acaac35-8032-4016-9d62-fc94e4b37b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c989c0-8d21-40d1-bc9d-9d5010bc6378", "name": "network-vif-plugged", "status": "completed", "tag": "73d4fae8-2faf-42dd-99fc-e6b6beee5ee6"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:41.085753 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:41.086352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f8c2c34b-1eaf-46c2-ab10-71be33fd21d8 req-8acaac35-8032-4016-9d62-fc94e4b37b4d service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:41.086442 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:41.087895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f8c2c34b-1eaf-46c2-ab10-71be33fd21d8 req-8acaac35-8032-4016-9d62-fc94e4b37b4d service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:41.100766 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:41.101556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:41.102695 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:41.103692 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:41.131781 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-f8c2c34b-1eaf-46c2-ab10-71be33fd21d8 req-8acaac35-8032-4016-9d62-fc94e4b37b4d service nova] Creating event network-vif-plugged:73d4fae8-2faf-42dd-99fc-e6b6beee5ee6 for instance 25c989c0-8d21-40d1-bc9d-9d5010bc6378 on hv-cinder-79760 Jul 04 08:05:41.149156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-f8c2c34b-1eaf-46c2-ab10-71be33fd21d8 req-8acaac35-8032-4016-9d62-fc94e4b37b4d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090754 Jul 04 08:05:41.152166 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 113/215] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:05:41.387661 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8a8e3b0c-d891-4fac-b226-8a73bac3104a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:41.389896 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8a8e3b0c-d891-4fac-b226-8a73bac3104a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:41.399182 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8a8e3b0c-d891-4fac-b226-8a73bac3104a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:41.399531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8a8e3b0c-d891-4fac-b226-8a73bac3104a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:41.400541 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8a8e3b0c-d891-4fac-b226-8a73bac3104a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:41.400975 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8a8e3b0c-d891-4fac-b226-8a73bac3104a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:41.592962 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:41.625610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:41.630339 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:41.634583 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-accd0951-8891-4c48-a95c-c7f1abe39d8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.552559 Jul 04 08:05:41.636840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 103/216] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:41 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:05:41.649336 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bc00f85d-7da6-4bd5-9cbc-e4d3f3c1a2d0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:41.651237 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bc00f85d-7da6-4bd5-9cbc-e4d3f3c1a2d0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:41.659736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8a8e3b0c-d891-4fac-b226-8a73bac3104a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:41.666622 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bc00f85d-7da6-4bd5-9cbc-e4d3f3c1a2d0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:41.668028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bc00f85d-7da6-4bd5-9cbc-e4d3f3c1a2d0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:41.669966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bc00f85d-7da6-4bd5-9cbc-e4d3f3c1a2d0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:41.671033 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bc00f85d-7da6-4bd5-9cbc-e4d3f3c1a2d0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:41.683114 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8a8e3b0c-d891-4fac-b226-8a73bac3104a tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1318 microversion: 2.1 time: 0.307710 Jul 04 08:05:41.704346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 114/217] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:41 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1318 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:41.948242 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bc00f85d-7da6-4bd5-9cbc-e4d3f3c1a2d0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:41.979573 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1885999850", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e86146d1-c8e4-49f2-af91-e63989951c39"}], "security_groups": [{"name": "tempest-securitygroup--1957833183"}], "key_name": "tempest-keypair-567698803", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:41.983283 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bc00f85d-7da6-4bd5-9cbc-e4d3f3c1a2d0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.344129 Jul 04 08:05:41.984347 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 104/218] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:41 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:42.004214 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2e2631b7-cf49-40f5-b455-75f27e19a477 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:42.005728 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2e2631b7-cf49-40f5-b455-75f27e19a477 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:42.019349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2e2631b7-cf49-40f5-b455-75f27e19a477 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:42.020273 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2e2631b7-cf49-40f5-b455-75f27e19a477 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:42.022053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2e2631b7-cf49-40f5-b455-75f27e19a477 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:42.023460 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2e2631b7-cf49-40f5-b455-75f27e19a477 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:42.198915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] validate_networks() for [('e86146d1-c8e4-49f2-af91-e63989951c39', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:05:42.232308 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2e2631b7-cf49-40f5-b455-75f27e19a477 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:42.248134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2e2631b7-cf49-40f5-b455-75f27e19a477 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.252309 Jul 04 08:05:42.249211 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 105/219] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:41 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:42.678754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:42.680916 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:42.694416 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:42.694977 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:42.696039 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:42.696701 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:42.847895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:05:42.848936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:05:42.850075 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:05:42.851077 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:05:42.853209 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:05:42.868830 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:42.869727 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:42.870813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:42.871356 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:42.896323 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for project de5226d001fb47b399172b6633fec844. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:05:42.903058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for user 126ba607541e4c4895b47b4b7602ce01 and project de5226d001fb47b399172b6633fec844. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:05:42.918753 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:05:42.921560 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:05:42.968312 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:43.000540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:43.006353 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:43.013687 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9b715930-d571-4649-83b1-13cc09da4161 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.041807 Jul 04 08:05:43.014998 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-71d64c08-d29e-411f-86a4-c408ae70dde2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.345055 Jul 04 08:05:43.025709 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 106/220] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:42 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:43.026753 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ca645edf-16ac-4c20-9185-e52070e1a313 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:43.041836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 115/221] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:05:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 08:05:43.042820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6e01be63-1c25-4cff-9142-e4e876b9534c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:43.043933 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6e01be63-1c25-4cff-9142-e4e876b9534c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:43.052181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ca645edf-16ac-4c20-9185-e52070e1a313 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:43.067306 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e01be63-1c25-4cff-9142-e4e876b9534c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:43.068110 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e01be63-1c25-4cff-9142-e4e876b9534c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:43.075796 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca645edf-16ac-4c20-9185-e52070e1a313 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:43.076936 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca645edf-16ac-4c20-9185-e52070e1a313 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:43.078333 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e01be63-1c25-4cff-9142-e4e876b9534c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:43.079258 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e01be63-1c25-4cff-9142-e4e876b9534c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:43.086790 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca645edf-16ac-4c20-9185-e52070e1a313 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:43.087638 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca645edf-16ac-4c20-9185-e52070e1a313 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:43.374612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ca645edf-16ac-4c20-9185-e52070e1a313 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:43.382775 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:43.392045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ca645edf-16ac-4c20-9185-e52070e1a313 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1318 microversion: 2.1 time: 0.374422 Jul 04 08:05:43.393830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 107/222] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:43 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:43.402847 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-57187f11-fa11-488e-ba10-e50456592d78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:43.404059 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-57187f11-fa11-488e-ba10-e50456592d78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:43.499314 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-57187f11-fa11-488e-ba10-e50456592d78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:43.500878 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6e01be63-1c25-4cff-9142-e4e876b9534c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:43.515098 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6e01be63-1c25-4cff-9142-e4e876b9534c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.479448 Jul 04 08:05:43.516678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 116/223] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:43 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:43.518794 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-57187f11-fa11-488e-ba10-e50456592d78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1241 microversion: 2.1 time: 0.123066 Jul 04 08:05:43.520482 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 108/224] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:43 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:43.534407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-a075e1eb-a601-4774-875e-0c6dd1b87292 req-f1f43caf-6f05-4dcf-b46c-8014eddbf39c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67c0a90-28f0-44b7-9c91-d25c02ce9928", "name": "network-vif-plugged", "status": "completed", "tag": "197c6bcb-bf0d-428c-b74d-952bae34c47e"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:43.544008 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-655d30d0-d162-41ef-90e1-90fa703419bf tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:43.545284 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-655d30d0-d162-41ef-90e1-90fa703419bf tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:43.546005 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-a075e1eb-a601-4774-875e-0c6dd1b87292 req-f1f43caf-6f05-4dcf-b46c-8014eddbf39c service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:43.546785 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-a075e1eb-a601-4774-875e-0c6dd1b87292 req-f1f43caf-6f05-4dcf-b46c-8014eddbf39c service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:43.558721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-655d30d0-d162-41ef-90e1-90fa703419bf tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:43.560183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-655d30d0-d162-41ef-90e1-90fa703419bf tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:43.562212 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-655d30d0-d162-41ef-90e1-90fa703419bf tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:43.563474 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-655d30d0-d162-41ef-90e1-90fa703419bf tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:43.567769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-a075e1eb-a601-4774-875e-0c6dd1b87292 req-f1f43caf-6f05-4dcf-b46c-8014eddbf39c service nova] Creating event network-vif-plugged:197c6bcb-bf0d-428c-b74d-952bae34c47e for instance a67c0a90-28f0-44b7-9c91-d25c02ce9928 on hv-cinder-79760 Jul 04 08:05:43.576456 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-a075e1eb-a601-4774-875e-0c6dd1b87292 req-f1f43caf-6f05-4dcf-b46c-8014eddbf39c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056943 Jul 04 08:05:43.577581 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 117/225] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:43.761339 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-655d30d0-d162-41ef-90e1-90fa703419bf tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:43.774316 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-655d30d0-d162-41ef-90e1-90fa703419bf tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.237722 Jul 04 08:05:43.776035 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 109/226] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:43 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:44.048130 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:44.049675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:44.056771 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.057222 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:44.058033 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.058462 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:44.260719 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:44.273486 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:44.275209 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:44.276446 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-892586b5-eb63-4f1a-8081-b63bba75df3a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.234529 Jul 04 08:05:44.277022 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 118/227] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:44 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:44.427939 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5c4a92a9-b46c-4d6e-80f0-310d1fac0a2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:44.429275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5c4a92a9-b46c-4d6e-80f0-310d1fac0a2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:44.437098 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c4a92a9-b46c-4d6e-80f0-310d1fac0a2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.437562 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c4a92a9-b46c-4d6e-80f0-310d1fac0a2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:44.438403 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c4a92a9-b46c-4d6e-80f0-310d1fac0a2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.438833 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5c4a92a9-b46c-4d6e-80f0-310d1fac0a2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:44.537287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b745c6aa-6946-4204-9289-0fa57c3941a4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:44.538286 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b745c6aa-6946-4204-9289-0fa57c3941a4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:44.550405 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b745c6aa-6946-4204-9289-0fa57c3941a4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.551175 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b745c6aa-6946-4204-9289-0fa57c3941a4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:44.553056 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b745c6aa-6946-4204-9289-0fa57c3941a4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.553597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b745c6aa-6946-4204-9289-0fa57c3941a4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:44.622108 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5c4a92a9-b46c-4d6e-80f0-310d1fac0a2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:44.645400 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5c4a92a9-b46c-4d6e-80f0-310d1fac0a2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1507 microversion: 2.1 time: 0.220955 Jul 04 08:05:44.646824 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 110/228] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:44 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:44.668077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-303f2f52-90db-494a-985d-03e208da3d0c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:44.669162 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-303f2f52-90db-494a-985d-03e208da3d0c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:44.688187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-303f2f52-90db-494a-985d-03e208da3d0c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.688879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-303f2f52-90db-494a-985d-03e208da3d0c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:44.690115 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-303f2f52-90db-494a-985d-03e208da3d0c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.694326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-303f2f52-90db-494a-985d-03e208da3d0c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:44.887579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b745c6aa-6946-4204-9289-0fa57c3941a4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:44.897232 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b745c6aa-6946-4204-9289-0fa57c3941a4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.367081 Jul 04 08:05:44.898404 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 119/229] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:44 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:44.907358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-303f2f52-90db-494a-985d-03e208da3d0c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:44.916345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e9f4f68a-4330-4501-b985-0ddb87f88ecd tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:44.917341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e9f4f68a-4330-4501-b985-0ddb87f88ecd tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:44.923854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-303f2f52-90db-494a-985d-03e208da3d0c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1237 microversion: 2.1 time: 0.266058 Jul 04 08:05:44.925246 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 111/230] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:44 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1237 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:44.928635 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9f4f68a-4330-4501-b985-0ddb87f88ecd tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.929386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9f4f68a-4330-4501-b985-0ddb87f88ecd tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:44.931610 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9f4f68a-4330-4501-b985-0ddb87f88ecd tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:44.932905 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9f4f68a-4330-4501-b985-0ddb87f88ecd tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:45.148457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e9f4f68a-4330-4501-b985-0ddb87f88ecd tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:45.160300 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e9f4f68a-4330-4501-b985-0ddb87f88ecd tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.251586 Jul 04 08:05:45.161135 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 120/231] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:44 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:45.322716 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:45.324501 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:45.349243 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:45.354097 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:45.355625 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:45.356391 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:45.642651 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:45.657915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:45.660434 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:45.662158 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f77c63f0-42e8-4ef9-9b81-9c378fa55aec tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.361977 Jul 04 08:05:45.662887 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 112/232] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:45 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:45.919794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c48578e6-164e-4e68-b4ba-a669c021bd7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:45.920961 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c48578e6-164e-4e68-b4ba-a669c021bd7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:45.932110 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c48578e6-164e-4e68-b4ba-a669c021bd7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:45.932713 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c48578e6-164e-4e68-b4ba-a669c021bd7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:45.934128 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c48578e6-164e-4e68-b4ba-a669c021bd7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:45.934881 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c48578e6-164e-4e68-b4ba-a669c021bd7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:45.944849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9be15384-84f4-4384-8f47-0264b5a04e41 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:45.945454 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9be15384-84f4-4384-8f47-0264b5a04e41 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:45.955403 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9be15384-84f4-4384-8f47-0264b5a04e41 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:45.956240 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9be15384-84f4-4384-8f47-0264b5a04e41 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:45.957708 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9be15384-84f4-4384-8f47-0264b5a04e41 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:45.958497 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9be15384-84f4-4384-8f47-0264b5a04e41 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:46.043530 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9be15384-84f4-4384-8f47-0264b5a04e41 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:46.052584 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9be15384-84f4-4384-8f47-0264b5a04e41 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1293 microversion: 2.1 time: 0.112363 Jul 04 08:05:46.053189 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 113/233] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:45 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:46.130574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c48578e6-164e-4e68-b4ba-a669c021bd7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:46.139400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c48578e6-164e-4e68-b4ba-a669c021bd7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.226446 Jul 04 08:05:46.139985 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 121/234] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:45 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:46.182035 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3f8230fa-29f6-44b4-af8b-64717f9b44b8 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:46.183281 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3f8230fa-29f6-44b4-af8b-64717f9b44b8 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:46.195378 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f8230fa-29f6-44b4-af8b-64717f9b44b8 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:46.196232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f8230fa-29f6-44b4-af8b-64717f9b44b8 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:46.197652 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f8230fa-29f6-44b4-af8b-64717f9b44b8 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:46.198467 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f8230fa-29f6-44b4-af8b-64717f9b44b8 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:46.606603 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e2533812-f494-44f2-a0ca-9b5ac3586251 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:46.624910 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2533812-f494-44f2-a0ca-9b5ac3586251 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:46.625792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2533812-f494-44f2-a0ca-9b5ac3586251 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:46.757707 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3f8230fa-29f6-44b4-af8b-64717f9b44b8 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:46.774937 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e2533812-f494-44f2-a0ca-9b5ac3586251 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Going to try to stop instance {{(pid=117871) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 08:05:46.775406 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3f8230fa-29f6-44b4-af8b-64717f9b44b8 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1315 microversion: 2.1 time: 0.601050 Jul 04 08:05:46.776321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 114/235] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:46 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:46.787271 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:46.789181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:46.798527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:46.799221 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:46.800039 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:46.806879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:46.867190 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e2533812-f494-44f2-a0ca-9b5ac3586251 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/action" status: 202 len: 0 microversion: 2.1 time: 0.266776 Jul 04 08:05:46.868728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 122/236] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:05:46 2022] POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/action => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 08:05:46.889260 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2f739e54-e231-412b-8192-f6e722f39ac6 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:46.891156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2f739e54-e231-412b-8192-f6e722f39ac6 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:46.908656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2f739e54-e231-412b-8192-f6e722f39ac6 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:46.909902 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2f739e54-e231-412b-8192-f6e722f39ac6 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:46.912325 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2f739e54-e231-412b-8192-f6e722f39ac6 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:46.914579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2f739e54-e231-412b-8192-f6e722f39ac6 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:47.175786 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:47.188427 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:47.194450 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:47.197004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-699a7e42-cc0b-4ea9-b5d0-160d7a901ba3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.419106 Jul 04 08:05:47.201149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2f739e54-e231-412b-8192-f6e722f39ac6 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:47.211454 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 115/237] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:46 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:47.217385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2f739e54-e231-412b-8192-f6e722f39ac6 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.343735 Jul 04 08:05:47.218499 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 123/238] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:46 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:47.218685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3da57099-012e-47f5-8f1a-2e21acf1eee1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:47.219269 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3da57099-012e-47f5-8f1a-2e21acf1eee1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:47.226957 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3da57099-012e-47f5-8f1a-2e21acf1eee1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:47.227305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3da57099-012e-47f5-8f1a-2e21acf1eee1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:47.227722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a74dbbaf-d535-418f-8b2b-91ca5c2e95b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:47.228586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3da57099-012e-47f5-8f1a-2e21acf1eee1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:47.228708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a74dbbaf-d535-418f-8b2b-91ca5c2e95b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:47.229323 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3da57099-012e-47f5-8f1a-2e21acf1eee1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:47.247156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a74dbbaf-d535-418f-8b2b-91ca5c2e95b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:47.248082 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a74dbbaf-d535-418f-8b2b-91ca5c2e95b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:47.249544 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a74dbbaf-d535-418f-8b2b-91ca5c2e95b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:47.250459 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a74dbbaf-d535-418f-8b2b-91ca5c2e95b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:47.504023 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3da57099-012e-47f5-8f1a-2e21acf1eee1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:47.515245 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a74dbbaf-d535-418f-8b2b-91ca5c2e95b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:47.523392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3da57099-012e-47f5-8f1a-2e21acf1eee1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1301 microversion: 2.1 time: 0.309836 Jul 04 08:05:47.525855 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 116/239] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:47 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1301 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:47.533822 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a74dbbaf-d535-418f-8b2b-91ca5c2e95b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.312460 Jul 04 08:05:47.535283 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 124/240] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:47 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:47.807207 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-644b63b9-7709-4515-acef-9a0f20dacb6e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:47.808299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-644b63b9-7709-4515-acef-9a0f20dacb6e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:47.823485 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-644b63b9-7709-4515-acef-9a0f20dacb6e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:47.824311 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-644b63b9-7709-4515-acef-9a0f20dacb6e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:47.825895 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-644b63b9-7709-4515-acef-9a0f20dacb6e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:47.826738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-644b63b9-7709-4515-acef-9a0f20dacb6e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.097086 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-644b63b9-7709-4515-acef-9a0f20dacb6e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:48.105471 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-644b63b9-7709-4515-acef-9a0f20dacb6e tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1464 microversion: 2.1 time: 0.305514 Jul 04 08:05:48.106342 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 117/241] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:47 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1464 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:48.164193 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f36c5662-07f1-4821-a728-85f3605353c9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:48.164708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f36c5662-07f1-4821-a728-85f3605353c9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:48.172773 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f36c5662-07f1-4821-a728-85f3605353c9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.173327 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f36c5662-07f1-4821-a728-85f3605353c9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.174182 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f36c5662-07f1-4821-a728-85f3605353c9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.174624 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f36c5662-07f1-4821-a728-85f3605353c9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.217975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:48.218781 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:48.219211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f36c5662-07f1-4821-a728-85f3605353c9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:05:48.226753 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.227311 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.228173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.228917 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.392242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f36c5662-07f1-4821-a728-85f3605353c9 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 204 len: 0 microversion: 2.1 time: 0.231432 Jul 04 08:05:48.393226 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 125/242] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:05:48 2022] DELETE /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 08:05:48.403142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b13a9b2b-4788-487a-abe6-6287e3a12c39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:48.404270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b13a9b2b-4788-487a-abe6-6287e3a12c39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:48.416649 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b13a9b2b-4788-487a-abe6-6287e3a12c39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.418322 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b13a9b2b-4788-487a-abe6-6287e3a12c39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.419639 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b13a9b2b-4788-487a-abe6-6287e3a12c39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.420716 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b13a9b2b-4788-487a-abe6-6287e3a12c39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.577426 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:48.611058 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:48.616183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:48.619116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-619ae47a-91b8-47ba-89a7-91770c6770f2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.405100 Jul 04 08:05:48.626801 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 118/243] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:48 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:05:48.647098 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-93a6c354-a8e9-45d3-9a5f-19acf0b765d5 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:48.647957 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-93a6c354-a8e9-45d3-9a5f-19acf0b765d5 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:48.665232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93a6c354-a8e9-45d3-9a5f-19acf0b765d5 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93a6c354-a8e9-45d3-9a5f-19acf0b765d5 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.666531 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93a6c354-a8e9-45d3-9a5f-19acf0b765d5 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.666975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93a6c354-a8e9-45d3-9a5f-19acf0b765d5 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.688110 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:48.892527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b13a9b2b-4788-487a-abe6-6287e3a12c39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:48.920077 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b13a9b2b-4788-487a-abe6-6287e3a12c39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.523895 Jul 04 08:05:48.926687 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 126/244] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:48 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:48.928759 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-93a6c354-a8e9-45d3-9a5f-19acf0b765d5 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:48.937082 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3070346e-2ff0-40f6-aa86-610527477351 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:48.938383 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3070346e-2ff0-40f6-aa86-610527477351 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:48.950709 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3070346e-2ff0-40f6-aa86-610527477351 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.951617 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3070346e-2ff0-40f6-aa86-610527477351 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.953083 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3070346e-2ff0-40f6-aa86-610527477351 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.953734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3070346e-2ff0-40f6-aa86-610527477351 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:48.954841 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-93a6c354-a8e9-45d3-9a5f-19acf0b765d5 tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1470 microversion: 2.1 time: 0.323042 Jul 04 08:05:48.956023 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 119/245] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:48 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1470 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:48.967238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c4edb1b2-b6d8-4601-a019-d298cd496e6c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:48.968510 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c4edb1b2-b6d8-4601-a019-d298cd496e6c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:48.995663 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4edb1b2-b6d8-4601-a019-d298cd496e6c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:48.998436 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4edb1b2-b6d8-4601-a019-d298cd496e6c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:49.006393 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4edb1b2-b6d8-4601-a019-d298cd496e6c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:49.007272 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c4edb1b2-b6d8-4601-a019-d298cd496e6c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:49.106013 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3070346e-2ff0-40f6-aa86-610527477351 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:49.120481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3070346e-2ff0-40f6-aa86-610527477351 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1299 microversion: 2.1 time: 0.191912 Jul 04 08:05:49.121104 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 127/246] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:48 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1299 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:49.209313 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c4edb1b2-b6d8-4601-a019-d298cd496e6c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:49.218786 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c4edb1b2-b6d8-4601-a019-d298cd496e6c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.260758 Jul 04 08:05:49.219431 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 120/247] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:48 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:49.651634 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:49.652932 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:49.660678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:49.661140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:49.661988 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:49.662440 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:49.847869 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:49.861728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:49.864364 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:49.867409 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3eeb507c-4100-4860-866a-36669b4e07ee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.219332 Jul 04 08:05:49.868545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 128/248] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:49 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:49.954602 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fb982170-6e49-46bf-95f8-549a1ac3436d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:49.955467 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fb982170-6e49-46bf-95f8-549a1ac3436d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:49.964730 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb982170-6e49-46bf-95f8-549a1ac3436d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:49.965200 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb982170-6e49-46bf-95f8-549a1ac3436d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:49.966069 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb982170-6e49-46bf-95f8-549a1ac3436d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:49.966497 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb982170-6e49-46bf-95f8-549a1ac3436d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:49.997513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4f5a5841-6c51-43e6-bfda-b7aaf43edd1c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:49.998784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4f5a5841-6c51-43e6-bfda-b7aaf43edd1c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:50.010675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f5a5841-6c51-43e6-bfda-b7aaf43edd1c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:50.011466 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f5a5841-6c51-43e6-bfda-b7aaf43edd1c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:50.012866 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f5a5841-6c51-43e6-bfda-b7aaf43edd1c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:50.013721 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f5a5841-6c51-43e6-bfda-b7aaf43edd1c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:50.238547 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fb982170-6e49-46bf-95f8-549a1ac3436d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:50.249110 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fb982170-6e49-46bf-95f8-549a1ac3436d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.300847 Jul 04 08:05:50.260594 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 121/249] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:49 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:50.272792 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-00ad188e-834c-470a-965f-7d6d38050dbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:50.273496 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-00ad188e-834c-470a-965f-7d6d38050dbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:50.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00ad188e-834c-470a-965f-7d6d38050dbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:50.283108 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00ad188e-834c-470a-965f-7d6d38050dbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:50.284589 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00ad188e-834c-470a-965f-7d6d38050dbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:50.285297 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00ad188e-834c-470a-965f-7d6d38050dbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:50.285693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4f5a5841-6c51-43e6-bfda-b7aaf43edd1c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:50.299835 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4f5a5841-6c51-43e6-bfda-b7aaf43edd1c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1470 microversion: 2.1 time: 0.308330 Jul 04 08:05:50.303208 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 129/250] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:49 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1470 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:50.321293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-06aacf65-3a54-4545-92a1-ac6c1259c1f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:50.323165 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-06aacf65-3a54-4545-92a1-ac6c1259c1f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:50.335991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-06aacf65-3a54-4545-92a1-ac6c1259c1f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:50.337726 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-06aacf65-3a54-4545-92a1-ac6c1259c1f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:50.338721 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-06aacf65-3a54-4545-92a1-ac6c1259c1f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:50.339645 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-06aacf65-3a54-4545-92a1-ac6c1259c1f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:50.391542 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-00ad188e-834c-470a-965f-7d6d38050dbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:50.403374 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-00ad188e-834c-470a-965f-7d6d38050dbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1299 microversion: 2.1 time: 0.141233 Jul 04 08:05:50.403984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 122/251] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:50 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1299 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:50.614274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-06aacf65-3a54-4545-92a1-ac6c1259c1f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:50.635191 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-06aacf65-3a54-4545-92a1-ac6c1259c1f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.329278 Jul 04 08:05:50.636209 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 130/252] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:50 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:50.893336 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:50.894677 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:50.908799 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:50.908799 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:50.910531 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:50.911485 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:51.268991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3972f15f-7796-43c5-8402-c344c1ad8209 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:51.274258 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3972f15f-7796-43c5-8402-c344c1ad8209 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:51.282955 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3972f15f-7796-43c5-8402-c344c1ad8209 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:51.283916 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3972f15f-7796-43c5-8402-c344c1ad8209 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:51.284926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3972f15f-7796-43c5-8402-c344c1ad8209 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:51.285509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3972f15f-7796-43c5-8402-c344c1ad8209 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:51.303522 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:51.318239 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:51.320441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:51.322022 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6a17cf15-98e0-42a3-9bc2-fd7de1793b9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.436633 Jul 04 08:05:51.323142 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 123/253] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:50 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:51.329571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8f4ffb50-ef2d-4322-9397-b028e69a046c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:51.330852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8f4ffb50-ef2d-4322-9397-b028e69a046c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:51.338615 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8f4ffb50-ef2d-4322-9397-b028e69a046c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:51.339507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8f4ffb50-ef2d-4322-9397-b028e69a046c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:51.340557 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8f4ffb50-ef2d-4322-9397-b028e69a046c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:51.341271 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8f4ffb50-ef2d-4322-9397-b028e69a046c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:51.522009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3972f15f-7796-43c5-8402-c344c1ad8209 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:51.543618 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3972f15f-7796-43c5-8402-c344c1ad8209 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.278781 Jul 04 08:05:51.545107 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 131/254] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:51 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:51.558082 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4c01ebac-a6e6-49bd-bf4f-5ee435d05d11 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:51.558984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4c01ebac-a6e6-49bd-bf4f-5ee435d05d11 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:51.571076 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4c01ebac-a6e6-49bd-bf4f-5ee435d05d11 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:51.571844 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4c01ebac-a6e6-49bd-bf4f-5ee435d05d11 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:51.573331 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4c01ebac-a6e6-49bd-bf4f-5ee435d05d11 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:51.575244 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4c01ebac-a6e6-49bd-bf4f-5ee435d05d11 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:51.866048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4c01ebac-a6e6-49bd-bf4f-5ee435d05d11 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:51.875906 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4c01ebac-a6e6-49bd-bf4f-5ee435d05d11 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1367 microversion: 2.1 time: 0.327600 Jul 04 08:05:51.876931 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 132/255] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:51 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:51.882421 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-51547b1b-b6d8-4588-abd7-b440d8496a5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:51.883196 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-51547b1b-b6d8-4588-abd7-b440d8496a5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:51.904487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-51547b1b-b6d8-4588-abd7-b440d8496a5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:51.905255 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-51547b1b-b6d8-4588-abd7-b440d8496a5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:51.907484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-51547b1b-b6d8-4588-abd7-b440d8496a5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:51.908265 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-51547b1b-b6d8-4588-abd7-b440d8496a5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:51.926897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8f4ffb50-ef2d-4322-9397-b028e69a046c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fd15df599fa4261b917f4f9b1d1f75a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '753d5874ae814841af6314a4db696221', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:51.951544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8f4ffb50-ef2d-4322-9397-b028e69a046c tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 200 len: 1470 microversion: 2.1 time: 0.611742 Jul 04 08:05:51.953570 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 124/256] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:51 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 1470 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:51.982419 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-67a0463b-8fa7-489e-95a9-a9245ab7799d req-9448cf8e-6ec9-4351-b285-8c0c474c4a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a67c0a90-28f0-44b7-9c91-d25c02ce9928", "name": "network-vif-deleted", "tag": "197c6bcb-bf0d-428c-b74d-952bae34c47e"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:52.001644 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-67a0463b-8fa7-489e-95a9-a9245ab7799d req-9448cf8e-6ec9-4351-b285-8c0c474c4a3f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:52.002935 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-67a0463b-8fa7-489e-95a9-a9245ab7799d req-9448cf8e-6ec9-4351-b285-8c0c474c4a3f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:52.048042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-67a0463b-8fa7-489e-95a9-a9245ab7799d req-9448cf8e-6ec9-4351-b285-8c0c474c4a3f service nova] Creating event network-vif-deleted:197c6bcb-bf0d-428c-b74d-952bae34c47e for instance a67c0a90-28f0-44b7-9c91-d25c02ce9928 on hv-cinder-79760 Jul 04 08:05:52.062383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-67a0463b-8fa7-489e-95a9-a9245ab7799d req-9448cf8e-6ec9-4351-b285-8c0c474c4a3f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083748 Jul 04 08:05:52.070009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 125/257] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:05:52.250309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-51547b1b-b6d8-4588-abd7-b440d8496a5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:52.275059 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-51547b1b-b6d8-4588-abd7-b440d8496a5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.396195 Jul 04 08:05:52.276531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 133/258] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:51 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:52.345586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:52.346876 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:52.359531 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:52.363763 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:52.364941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:52.365502 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:52.371035 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:52.574101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2e2c295d-02d1-4de9-8fcb-d4d6cb4e9e19 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:52.574652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2e2c295d-02d1-4de9-8fcb-d4d6cb4e9e19 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:52.581719 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e2c295d-02d1-4de9-8fcb-d4d6cb4e9e19 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:52.583396 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e2c295d-02d1-4de9-8fcb-d4d6cb4e9e19 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:52.585053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e2c295d-02d1-4de9-8fcb-d4d6cb4e9e19 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:52.586085 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e2c295d-02d1-4de9-8fcb-d4d6cb4e9e19 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:52.680506 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:52.711619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:52.733042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:52.735260 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-81112d70-5b09-4818-857b-59699593f2e6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.396685 Jul 04 08:05:52.737708 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 126/259] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:52 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:05:52.880386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:52.908807 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f55dddaa-0ed5-43b5-b284-aac721d88523 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:52.910139 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f55dddaa-0ed5-43b5-b284-aac721d88523 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:52.912222 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:52.946099 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f55dddaa-0ed5-43b5-b284-aac721d88523 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:52.947534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f55dddaa-0ed5-43b5-b284-aac721d88523 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:52.949486 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f55dddaa-0ed5-43b5-b284-aac721d88523 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:52.950663 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f55dddaa-0ed5-43b5-b284-aac721d88523 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:53.051243 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2e2c295d-02d1-4de9-8fcb-d4d6cb4e9e19 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:53.070316 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2e2c295d-02d1-4de9-8fcb-d4d6cb4e9e19 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.499001 Jul 04 08:05:53.071670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 134/260] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:52 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:53.085612 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:53.088618 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] [instance: a67c0a90-28f0-44b7-9c91-d25c02ce9928] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:53.101676 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:53.106826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:53.108481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:53.111011 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:53.154399 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] HTTP exception thrown: Instance a67c0a90-28f0-44b7-9c91-d25c02ce9928 could not be found. Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Request method failure captured: Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 HTTP/1.1 Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp9DTCyW5l_gTNorZdyI3VYynh0gsWsYzAzCAsDLQ0rGGJoxCc7HGJo_IIHcu55E2okn2Q-mP3wZlEHE-LwwdjT7HcH3d6CAOBzmRwrYgsTrgOM4b08wUIgNu4ClZzpZfWjxHxTVDmF_4clg4e7pnUsVmoVy1ia5unPm8MCk-Ztss7c Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 753d5874ae814841af6314a4db696221 Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-1141095326 Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:05:53.161700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/753d5874ae814841af6314a4db696221"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/753d5874ae814841af6314a4db696221"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/753d5874ae814841af6314a4db696221"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_753d5874ae814841af6314a4db696221", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-1141095326 Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 753d5874ae814841af6314a4db696221 Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-1141095326 Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-1141095326-project Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 1fd15df599fa4261b917f4f9b1d1f75a Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-1141095326-project Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance a67c0a90-28f0-44b7-9c91-d25c02ce9928 could not be found. Jul 04 08:05:53.164151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': 'a67c0a90-28f0-44b7-9c91-d25c02ce9928'} Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a67c0a90-28f0-44b7-9c91-d25c02ce9928 could not be found. Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:05:53.165784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a67c0a90-28f0-44b7-9c91-d25c02ce9928 could not be found. Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a67c0a90-28f0-44b7-9c91-d25c02ce9928 could not be found. Jul 04 08:05:53.168118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:05:53.180247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] Returning 404 to user: Instance a67c0a90-28f0-44b7-9c91-d25c02ce9928 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:05:53.180247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-924633a1-f0d4-4d35-bfe2-62efcd25ebfc tempest-VolumesNegativeTest-1141095326 tempest-VolumesNegativeTest-1141095326-project] 10.222.0.43 "GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928" status: 404 len: 111 microversion: 2.1 time: 0.089710 Jul 04 08:05:53.180247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 135/261] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:53 2022] GET /compute/v2.1/servers/a67c0a90-28f0-44b7-9c91-d25c02ce9928 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:05:53.294763 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-189a594d-7571-4dc5-a3a0-4175352ce9e6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:53.295616 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-189a594d-7571-4dc5-a3a0-4175352ce9e6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:53.310118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-189a594d-7571-4dc5-a3a0-4175352ce9e6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:53.310575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-189a594d-7571-4dc5-a3a0-4175352ce9e6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:53.311401 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-189a594d-7571-4dc5-a3a0-4175352ce9e6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:53.311857 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-189a594d-7571-4dc5-a3a0-4175352ce9e6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:53.511164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:53.585873 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f55dddaa-0ed5-43b5-b284-aac721d88523 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:53.594771 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f55dddaa-0ed5-43b5-b284-aac721d88523 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1367 microversion: 2.1 time: 0.696458 Jul 04 08:05:53.597738 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-189a594d-7571-4dc5-a3a0-4175352ce9e6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:53.600859 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 127/262] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:52 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1367 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:53.608784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-189a594d-7571-4dc5-a3a0-4175352ce9e6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.317766 Jul 04 08:05:53.609787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 136/263] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:53 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:53.770568 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:53.771176 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:53.779251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:53.779977 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:53.780988 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:53.781599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:54.115591 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-beee872d-bf9b-4756-9917-2c9356e774ca req-bad95ec6-ebc0-40bd-ae9c-f40b0b2a7a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfe5154-5465-4c6b-a6c0-d41f8fcfb545", "tag": "151eb673-5017-4a41-910b-b1a450507544"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:54.141227 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-beee872d-bf9b-4756-9917-2c9356e774ca req-bad95ec6-ebc0-40bd-ae9c-f40b0b2a7a52 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:54.141748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-beee872d-bf9b-4756-9917-2c9356e774ca req-bad95ec6-ebc0-40bd-ae9c-f40b0b2a7a52 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:54.158156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-beee872d-bf9b-4756-9917-2c9356e774ca req-bad95ec6-ebc0-40bd-ae9c-f40b0b2a7a52 service nova] Creating event network-changed:151eb673-5017-4a41-910b-b1a450507544 for instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 on hv-cinder-79760 Jul 04 08:05:54.168276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-beee872d-bf9b-4756-9917-2c9356e774ca req-bad95ec6-ebc0-40bd-ae9c-f40b0b2a7a52 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056518 Jul 04 08:05:54.168276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 137/264] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 04 08:05:54.186905 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7e92bc0c-b00d-4e87-9854-1877769c3fdb tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:54.187951 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7e92bc0c-b00d-4e87-9854-1877769c3fdb tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:54.198810 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e92bc0c-b00d-4e87-9854-1877769c3fdb tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:54.199267 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e92bc0c-b00d-4e87-9854-1877769c3fdb tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:54.200060 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e92bc0c-b00d-4e87-9854-1877769c3fdb tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:54.200969 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e92bc0c-b00d-4e87-9854-1877769c3fdb tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:54.207275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:54.229881 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:54.232596 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:54.234103 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0b568998-f313-49c7-b485-7fb345131506 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.467784 Jul 04 08:05:54.237240 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 128/265] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:53 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:54.472217 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7e92bc0c-b00d-4e87-9854-1877769c3fdb tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:54.495487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7e92bc0c-b00d-4e87-9854-1877769c3fdb tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.327650 Jul 04 08:05:54.496653 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 138/266] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:54 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:54.617555 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-34d0f60f-811a-499c-9dc0-16a9f26913f4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:54.621086 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-34d0f60f-811a-499c-9dc0-16a9f26913f4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:54.638164 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d4515363-b745-407d-b55e-99a156c5ca41 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:54.639086 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d4515363-b745-407d-b55e-99a156c5ca41 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:54.647654 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4515363-b745-407d-b55e-99a156c5ca41 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:54.648404 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4515363-b745-407d-b55e-99a156c5ca41 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:54.649383 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4515363-b745-407d-b55e-99a156c5ca41 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:54.649993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34d0f60f-811a-499c-9dc0-16a9f26913f4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:54.650193 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4515363-b745-407d-b55e-99a156c5ca41 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:54.651161 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34d0f60f-811a-499c-9dc0-16a9f26913f4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:54.652595 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34d0f60f-811a-499c-9dc0-16a9f26913f4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:54.653035 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-34d0f60f-811a-499c-9dc0-16a9f26913f4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:54.860863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-34d0f60f-811a-499c-9dc0-16a9f26913f4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:54.869755 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d4515363-b745-407d-b55e-99a156c5ca41 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:54.878674 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-34d0f60f-811a-499c-9dc0-16a9f26913f4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1367 microversion: 2.1 time: 0.264649 Jul 04 08:05:54.879450 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 129/267] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:54 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:54.885946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d4515363-b745-407d-b55e-99a156c5ca41 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.251244 Jul 04 08:05:54.886556 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 139/268] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:54 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:55.260979 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:55.262858 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:55.280744 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:55.281417 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:55.282620 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:55.283186 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:55.529950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8b3a7f15-2619-4080-9fa2-00722e5bb05b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:55.532234 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8b3a7f15-2619-4080-9fa2-00722e5bb05b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:55.543864 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8b3a7f15-2619-4080-9fa2-00722e5bb05b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:55.545498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8b3a7f15-2619-4080-9fa2-00722e5bb05b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:55.547339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8b3a7f15-2619-4080-9fa2-00722e5bb05b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:55.548538 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8b3a7f15-2619-4080-9fa2-00722e5bb05b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:55.552697 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:55.567811 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:55.570468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:55.572713 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-920c7361-e3ff-44f1-b925-ca44c14729b9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.319353 Jul 04 08:05:55.574107 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 130/269] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:55 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:05:55.774858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8b3a7f15-2619-4080-9fa2-00722e5bb05b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:55.786677 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8b3a7f15-2619-4080-9fa2-00722e5bb05b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.265524 Jul 04 08:05:55.787629 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 140/270] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:55 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:55.901912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c60fdd5f-326d-46ca-98fe-5d24355d2272 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:55.903109 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c60fdd5f-326d-46ca-98fe-5d24355d2272 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:55.910305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-89f3996f-d2ec-400d-b296-28de88bb6927 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:55.910969 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-89f3996f-d2ec-400d-b296-28de88bb6927 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:55.920262 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c60fdd5f-326d-46ca-98fe-5d24355d2272 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:55.920711 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c60fdd5f-326d-46ca-98fe-5d24355d2272 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:55.922633 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c60fdd5f-326d-46ca-98fe-5d24355d2272 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:55.923346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-89f3996f-d2ec-400d-b296-28de88bb6927 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:55.923480 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c60fdd5f-326d-46ca-98fe-5d24355d2272 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:55.930178 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-89f3996f-d2ec-400d-b296-28de88bb6927 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:55.931416 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-89f3996f-d2ec-400d-b296-28de88bb6927 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:55.932004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-89f3996f-d2ec-400d-b296-28de88bb6927 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:56.104496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-89f3996f-d2ec-400d-b296-28de88bb6927 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:56.119299 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-89f3996f-d2ec-400d-b296-28de88bb6927 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.212649 Jul 04 08:05:56.120372 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 141/271] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:55 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:56.191562 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c60fdd5f-326d-46ca-98fe-5d24355d2272 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:56.205247 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c60fdd5f-326d-46ca-98fe-5d24355d2272 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1367 microversion: 2.1 time: 0.311076 Jul 04 08:05:56.206198 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 131/272] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:55 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1367 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:56.596991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:56.597816 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:56.605787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:56.606305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:56.607176 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:56.607615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:56.789052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:56.798501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:56.800095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:56.801385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-64c62fde-eabf-4daf-a00e-797d65eea022 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1746 microversion: 2.20 time: 0.209200 Jul 04 08:05:56.801973 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 142/273] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:56 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1746 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:56.820707 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eb5d1724-9152-49bc-bd1c-37a28f741768 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:56.821567 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eb5d1724-9152-49bc-bd1c-37a28f741768 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:56.832048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb5d1724-9152-49bc-bd1c-37a28f741768 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:56.832939 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb5d1724-9152-49bc-bd1c-37a28f741768 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:56.834042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb5d1724-9152-49bc-bd1c-37a28f741768 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:56.834495 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb5d1724-9152-49bc-bd1c-37a28f741768 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:57.080088 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eb5d1724-9152-49bc-bd1c-37a28f741768 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:57.106905 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eb5d1724-9152-49bc-bd1c-37a28f741768 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.294756 Jul 04 08:05:57.117041 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 132/274] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:56 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:57.141378 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab41853a-bf70-4f9a-82d9-91a6bd8fe64f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:57.142673 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ab41853a-bf70-4f9a-82d9-91a6bd8fe64f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:57.153853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab41853a-bf70-4f9a-82d9-91a6bd8fe64f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:57.154435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab41853a-bf70-4f9a-82d9-91a6bd8fe64f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:57.155745 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab41853a-bf70-4f9a-82d9-91a6bd8fe64f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:57.156459 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab41853a-bf70-4f9a-82d9-91a6bd8fe64f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:57.240994 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7d810fef-cf0d-4e9f-98fb-1214162d8b79 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:57.242109 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7d810fef-cf0d-4e9f-98fb-1214162d8b79 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:57.249293 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7d810fef-cf0d-4e9f-98fb-1214162d8b79 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:57.249890 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7d810fef-cf0d-4e9f-98fb-1214162d8b79 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:57.250728 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7d810fef-cf0d-4e9f-98fb-1214162d8b79 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:57.251250 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7d810fef-cf0d-4e9f-98fb-1214162d8b79 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:57.378893 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ab41853a-bf70-4f9a-82d9-91a6bd8fe64f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:57.393297 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ab41853a-bf70-4f9a-82d9-91a6bd8fe64f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.259021 Jul 04 08:05:57.394793 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 143/275] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:57 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:57.511732 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7d810fef-cf0d-4e9f-98fb-1214162d8b79 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:57.532229 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7d810fef-cf0d-4e9f-98fb-1214162d8b79 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1367 microversion: 2.1 time: 0.296112 Jul 04 08:05:57.533173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 133/276] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:57 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:57.829715 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:57.831241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:57.845492 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:57.846386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:57.847888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:57.848695 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:57.893715 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:05:58.055628 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:58.065562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:58.067211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:58.068631 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a5962b41-bc72-469a-8dea-ae81e97903fb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1746 microversion: 2.20 time: 0.246921 Jul 04 08:05:58.069245 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 144/277] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:57 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1746 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:58.127944 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b88ea4b4-a54f-4938-94c8-7c48ee4df97b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:58.129009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b88ea4b4-a54f-4938-94c8-7c48ee4df97b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:58.135870 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b88ea4b4-a54f-4938-94c8-7c48ee4df97b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:58.136445 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b88ea4b4-a54f-4938-94c8-7c48ee4df97b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:58.137217 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b88ea4b4-a54f-4938-94c8-7c48ee4df97b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:58.137672 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b88ea4b4-a54f-4938-94c8-7c48ee4df97b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:58.347012 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b88ea4b4-a54f-4938-94c8-7c48ee4df97b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:58.363346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b88ea4b4-a54f-4938-94c8-7c48ee4df97b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.241061 Jul 04 08:05:58.364482 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 134/278] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:58 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:58.413021 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e950780d-6724-415c-8746-02980fec3e91 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:58.414016 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e950780d-6724-415c-8746-02980fec3e91 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:58.422927 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e950780d-6724-415c-8746-02980fec3e91 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:58.423888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e950780d-6724-415c-8746-02980fec3e91 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:58.424934 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e950780d-6724-415c-8746-02980fec3e91 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:58.425668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e950780d-6724-415c-8746-02980fec3e91 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:58.556538 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-14847a79-16fc-450c-9c63-adee61deb44d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:58.558455 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-14847a79-16fc-450c-9c63-adee61deb44d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:58.571533 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-14847a79-16fc-450c-9c63-adee61deb44d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:58.572461 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-14847a79-16fc-450c-9c63-adee61deb44d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:58.573942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-14847a79-16fc-450c-9c63-adee61deb44d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:58.574790 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-14847a79-16fc-450c-9c63-adee61deb44d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:58.651039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e950780d-6724-415c-8746-02980fec3e91 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:58.665058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e950780d-6724-415c-8746-02980fec3e91 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.257167 Jul 04 08:05:58.666155 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 145/279] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:58 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:58.855931 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-14847a79-16fc-450c-9c63-adee61deb44d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:58.866361 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-14847a79-16fc-450c-9c63-adee61deb44d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1367 microversion: 2.1 time: 0.318081 Jul 04 08:05:58.867726 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 135/280] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:58 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:05:59.089135 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:59.090651 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:59.099385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:59.100045 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:59.100997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:59.101867 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:59.274141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-75d9fafe-a9c6-4998-ba34-a473c0a31db3 req-d730e1e7-f62e-4069-a9a0-203ba975c0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfe5154-5465-4c6b-a6c0-d41f8fcfb545", "name": "network-vif-plugged", "status": "completed", "tag": "151eb673-5017-4a41-910b-b1a450507544"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:05:59.288800 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-75d9fafe-a9c6-4998-ba34-a473c0a31db3 req-d730e1e7-f62e-4069-a9a0-203ba975c0e2 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:59.289570 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-75d9fafe-a9c6-4998-ba34-a473c0a31db3 req-d730e1e7-f62e-4069-a9a0-203ba975c0e2 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:59.306826 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-75d9fafe-a9c6-4998-ba34-a473c0a31db3 req-d730e1e7-f62e-4069-a9a0-203ba975c0e2 service nova] Creating event network-vif-plugged:151eb673-5017-4a41-910b-b1a450507544 for instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 on hv-cinder-79760 Jul 04 08:05:59.315343 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-75d9fafe-a9c6-4998-ba34-a473c0a31db3 req-d730e1e7-f62e-4069-a9a0-203ba975c0e2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044804 Jul 04 08:05:59.317060 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 136/281] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:05:59.397121 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-87f30e62-82bf-465b-a226-ec6fc6905e7c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:59.398300 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-87f30e62-82bf-465b-a226-ec6fc6905e7c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:59.427243 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-87f30e62-82bf-465b-a226-ec6fc6905e7c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:59.430511 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-87f30e62-82bf-465b-a226-ec6fc6905e7c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:59.431589 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-87f30e62-82bf-465b-a226-ec6fc6905e7c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:59.433611 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-87f30e62-82bf-465b-a226-ec6fc6905e7c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:59.435420 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:59.448418 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:59.451753 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:59.457919 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f1878c89-c255-409e-816c-2c80548f276b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1746 microversion: 2.20 time: 0.370338 Jul 04 08:05:59.458871 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 146/282] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:05:59 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1746 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:05:59.705604 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-125ec1a1-b78c-4b33-bc36-a4f5223a3cc2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:59.706362 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-125ec1a1-b78c-4b33-bc36-a4f5223a3cc2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:59.738433 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-125ec1a1-b78c-4b33-bc36-a4f5223a3cc2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:59.741047 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-125ec1a1-b78c-4b33-bc36-a4f5223a3cc2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:59.743337 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-125ec1a1-b78c-4b33-bc36-a4f5223a3cc2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:59.760205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-125ec1a1-b78c-4b33-bc36-a4f5223a3cc2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:59.760449 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-87f30e62-82bf-465b-a226-ec6fc6905e7c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:05:59.777152 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-87f30e62-82bf-465b-a226-ec6fc6905e7c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.388464 Jul 04 08:05:59.780254 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 137/283] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:59 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:05:59.886448 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f301372b-f449-439e-b4cd-46adc8af9bf3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:05:59.888132 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f301372b-f449-439e-b4cd-46adc8af9bf3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:05:59.898270 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f301372b-f449-439e-b4cd-46adc8af9bf3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:59.899644 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f301372b-f449-439e-b4cd-46adc8af9bf3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:05:59.901115 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f301372b-f449-439e-b4cd-46adc8af9bf3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:05:59.902140 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f301372b-f449-439e-b4cd-46adc8af9bf3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:00.134244 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f301372b-f449-439e-b4cd-46adc8af9bf3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:00.149677 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f301372b-f449-439e-b4cd-46adc8af9bf3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1367 microversion: 2.1 time: 0.268868 Jul 04 08:06:00.152310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 138/284] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:59 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:00.207042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-125ec1a1-b78c-4b33-bc36-a4f5223a3cc2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:00.224851 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-125ec1a1-b78c-4b33-bc36-a4f5223a3cc2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.535549 Jul 04 08:06:00.226605 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 147/285] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:05:59 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:00.488420 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:00.491299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:00.503106 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:00.503707 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:00.505030 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:00.505835 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:00.753904 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:00.767731 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:00.771837 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:00.775349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d335811d-b021-4a1e-8e1e-28cef6fd6140 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.294415 Jul 04 08:06:00.791230 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 139/286] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:00 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:00.806169 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-729070dc-9875-4edb-9429-9a180f07f880 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:00.807153 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-729070dc-9875-4edb-9429-9a180f07f880 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:00.821506 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-729070dc-9875-4edb-9429-9a180f07f880 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:00.822323 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-729070dc-9875-4edb-9429-9a180f07f880 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:00.823728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-729070dc-9875-4edb-9429-9a180f07f880 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:00.830311 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-729070dc-9875-4edb-9429-9a180f07f880 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:01.170641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0e2f2a5a-8309-40ab-bd35-f54e59d28ae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:01.171431 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0e2f2a5a-8309-40ab-bd35-f54e59d28ae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:01.182546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0e2f2a5a-8309-40ab-bd35-f54e59d28ae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:01.183272 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0e2f2a5a-8309-40ab-bd35-f54e59d28ae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:01.184276 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0e2f2a5a-8309-40ab-bd35-f54e59d28ae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:01.185116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0e2f2a5a-8309-40ab-bd35-f54e59d28ae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:01.406772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0e2f2a5a-8309-40ab-bd35-f54e59d28ae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:01.417804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0e2f2a5a-8309-40ab-bd35-f54e59d28ae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1367 microversion: 2.1 time: 0.251244 Jul 04 08:06:01.419304 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 140/287] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:01 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:01.424915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-20addb49-c425-49b6-b44d-ddaea250a3b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:01.425975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-20addb49-c425-49b6-b44d-ddaea250a3b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:01.434782 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20addb49-c425-49b6-b44d-ddaea250a3b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:01.435254 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20addb49-c425-49b6-b44d-ddaea250a3b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:01.436173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20addb49-c425-49b6-b44d-ddaea250a3b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:01.436686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20addb49-c425-49b6-b44d-ddaea250a3b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:01.484068 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-729070dc-9875-4edb-9429-9a180f07f880 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:01.503120 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-729070dc-9875-4edb-9429-9a180f07f880 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.702682 Jul 04 08:06:01.519539 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 148/288] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:00 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:01.528609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-f39f5c1c-4e03-40d0-a422-2c637c9db927 req-5e376410-732d-4e18-92f4-37cafa487d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42c331b-8c2a-4f37-bd0a-7221b07bf3af", "name": "network-vif-plugged", "status": "completed", "tag": "624f3113-8fef-448f-b1f3-28db878c297b"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:01.541053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f39f5c1c-4e03-40d0-a422-2c637c9db927 req-5e376410-732d-4e18-92f4-37cafa487d80 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:01.541672 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f39f5c1c-4e03-40d0-a422-2c637c9db927 req-5e376410-732d-4e18-92f4-37cafa487d80 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:01.558906 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-f39f5c1c-4e03-40d0-a422-2c637c9db927 req-5e376410-732d-4e18-92f4-37cafa487d80 service nova] Creating event network-vif-plugged:624f3113-8fef-448f-b1f3-28db878c297b for instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af on hv-cinder-79760 Jul 04 08:06:01.565348 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-f39f5c1c-4e03-40d0-a422-2c637c9db927 req-5e376410-732d-4e18-92f4-37cafa487d80 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043925 Jul 04 08:06:01.566459 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 149/289] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:06:01.727522 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-20addb49-c425-49b6-b44d-ddaea250a3b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:01.741767 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-20addb49-c425-49b6-b44d-ddaea250a3b6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.320958 Jul 04 08:06:01.743260 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 141/290] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:01 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:01.810144 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:01.811583 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:01.821586 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:01.822455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:01.823557 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:01.824320 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:02.020269 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:02.037587 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:02.040778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:02.047147 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0993b1ef-4c26-458b-ae19-b9366608cad8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.242941 Jul 04 08:06:02.062826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 150/291] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:01 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:02.436984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eeca5fcf-d08f-4383-8d4d-81808a8afa7b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:02.438129 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eeca5fcf-d08f-4383-8d4d-81808a8afa7b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:02.446841 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eeca5fcf-d08f-4383-8d4d-81808a8afa7b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:02.447860 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eeca5fcf-d08f-4383-8d4d-81808a8afa7b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:02.448753 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eeca5fcf-d08f-4383-8d4d-81808a8afa7b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:02.449295 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eeca5fcf-d08f-4383-8d4d-81808a8afa7b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:02.532627 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8277188f-bf32-4b6f-b947-d264837915f8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:02.533735 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8277188f-bf32-4b6f-b947-d264837915f8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:02.539623 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:02.566953 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8277188f-bf32-4b6f-b947-d264837915f8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:02.567895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8277188f-bf32-4b6f-b947-d264837915f8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:02.569046 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8277188f-bf32-4b6f-b947-d264837915f8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:02.569834 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8277188f-bf32-4b6f-b947-d264837915f8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:02.889459 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8277188f-bf32-4b6f-b947-d264837915f8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:02.901163 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8277188f-bf32-4b6f-b947-d264837915f8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1723 microversion: 2.1 time: 0.377428 Jul 04 08:06:02.903192 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 151/292] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:02 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:02.909704 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e0d4129e-4491-40e5-9cd0-879a9321f70c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:02.911403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e0d4129e-4491-40e5-9cd0-879a9321f70c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:02.922554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e0d4129e-4491-40e5-9cd0-879a9321f70c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:02.924603 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e0d4129e-4491-40e5-9cd0-879a9321f70c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:02.925979 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e0d4129e-4491-40e5-9cd0-879a9321f70c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:02.927267 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e0d4129e-4491-40e5-9cd0-879a9321f70c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:02.970372 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eeca5fcf-d08f-4383-8d4d-81808a8afa7b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:02.984924 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eeca5fcf-d08f-4383-8d4d-81808a8afa7b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1557 microversion: 2.1 time: 0.552026 Jul 04 08:06:02.987004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 142/293] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:02 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1557 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:03.014068 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fd6fb59d-ed4d-4bce-9cdb-5b510e2f0446 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:03.014940 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fd6fb59d-ed4d-4bce-9cdb-5b510e2f0446 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:03.026175 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd6fb59d-ed4d-4bce-9cdb-5b510e2f0446 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:03.027310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd6fb59d-ed4d-4bce-9cdb-5b510e2f0446 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:03.029050 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd6fb59d-ed4d-4bce-9cdb-5b510e2f0446 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:03.030194 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fd6fb59d-ed4d-4bce-9cdb-5b510e2f0446 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:03.111044 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:03.261769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e0d4129e-4491-40e5-9cd0-879a9321f70c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:03.283946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e0d4129e-4491-40e5-9cd0-879a9321f70c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.377297 Jul 04 08:06:03.286071 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 152/294] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:02 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:03.297286 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:03.301343 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:03.319210 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:03.320353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:03.322196 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:03.324176 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:03.402988 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fd6fb59d-ed4d-4bce-9cdb-5b510e2f0446 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.403910 Jul 04 08:06:03.404987 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 143/295] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jul 4 08:06:02 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545/os-interface => generated 284 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:06:03.922194 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8d2c5cc2-13c1-4ff2-b734-6907e30f530b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:03.923717 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8d2c5cc2-13c1-4ff2-b734-6907e30f530b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:03.931009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:03.944536 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d2c5cc2-13c1-4ff2-b734-6907e30f530b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:03.945489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d2c5cc2-13c1-4ff2-b734-6907e30f530b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:03.946375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d2c5cc2-13c1-4ff2-b734-6907e30f530b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:03.946818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8d2c5cc2-13c1-4ff2-b734-6907e30f530b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:04.052501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:04.063075 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:04.065361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:04.067270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d260cf48-3094-4b45-b4c5-a2881986aabf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.778981 Jul 04 08:06:04.068488 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 153/296] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:03 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:04.173310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8d2c5cc2-13c1-4ff2-b734-6907e30f530b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:04.203719 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8d2c5cc2-13c1-4ff2-b734-6907e30f530b tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1700 microversion: 2.1 time: 0.286386 Jul 04 08:06:04.207682 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 144/297] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:03 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1700 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:04.229885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-43333ab1-be46-45c7-9b30-23be4733093c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:04.243784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-43333ab1-be46-45c7-9b30-23be4733093c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:04.244578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-43333ab1-be46-45c7-9b30-23be4733093c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:04.298748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-43333ab1-be46-45c7-9b30-23be4733093c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Going to try to start instance {{(pid=117871) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 08:06:04.306267 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-aada459e-1fff-41ec-b073-afef35f7c7f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:04.306897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-aada459e-1fff-41ec-b073-afef35f7c7f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:04.335333 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aada459e-1fff-41ec-b073-afef35f7c7f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:04.335799 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aada459e-1fff-41ec-b073-afef35f7c7f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:04.336684 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aada459e-1fff-41ec-b073-afef35f7c7f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:04.346025 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aada459e-1fff-41ec-b073-afef35f7c7f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:04.400514 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-43333ab1-be46-45c7-9b30-23be4733093c tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/action" status: 202 len: 0 microversion: 2.1 time: 0.174914 Jul 04 08:06:04.401698 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 154/298] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:06:04 2022] POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 08:06:04.412099 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c70b86e9-7e19-4f14-9da3-75523e1167df tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:04.413246 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c70b86e9-7e19-4f14-9da3-75523e1167df tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:04.433028 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c70b86e9-7e19-4f14-9da3-75523e1167df tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:04.434793 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c70b86e9-7e19-4f14-9da3-75523e1167df tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:04.439468 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c70b86e9-7e19-4f14-9da3-75523e1167df tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:04.440315 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c70b86e9-7e19-4f14-9da3-75523e1167df tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:04.703350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-aada459e-1fff-41ec-b073-afef35f7c7f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:04.726548 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-aada459e-1fff-41ec-b073-afef35f7c7f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.424812 Jul 04 08:06:04.747518 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 145/299] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:04 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:05.077451 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c70b86e9-7e19-4f14-9da3-75523e1167df tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:05.095427 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:05.101087 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:05.115400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c70b86e9-7e19-4f14-9da3-75523e1167df tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1709 microversion: 2.1 time: 0.704827 Jul 04 08:06:05.116341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 155/300] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:04 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1709 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:05.122957 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:05.123981 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:05.125064 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:05.125802 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:05.386826 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:05.401884 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:05.404023 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:05.405599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e73932e5-2639-4a51-9784-858c3fd61a61 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.317362 Jul 04 08:06:05.406608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 146/301] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:05 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:05.767365 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-88d9b972-7561-4d45-aa23-f7e5649c8fc5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:05.768584 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-88d9b972-7561-4d45-aa23-f7e5649c8fc5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:05.787308 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88d9b972-7561-4d45-aa23-f7e5649c8fc5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:05.788549 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88d9b972-7561-4d45-aa23-f7e5649c8fc5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:05.790406 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88d9b972-7561-4d45-aa23-f7e5649c8fc5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:05.791493 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88d9b972-7561-4d45-aa23-f7e5649c8fc5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:06.134540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-dcf69e7f-e53f-4a11-8a74-9a4be335a3a3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:06.135281 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-dcf69e7f-e53f-4a11-8a74-9a4be335a3a3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:06.146901 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dcf69e7f-e53f-4a11-8a74-9a4be335a3a3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:06.147652 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dcf69e7f-e53f-4a11-8a74-9a4be335a3a3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:06.148626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dcf69e7f-e53f-4a11-8a74-9a4be335a3a3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:06.149216 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dcf69e7f-e53f-4a11-8a74-9a4be335a3a3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:06.221502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-88d9b972-7561-4d45-aa23-f7e5649c8fc5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:06.247706 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-88d9b972-7561-4d45-aa23-f7e5649c8fc5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.491169 Jul 04 08:06:06.262127 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 156/302] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:05 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:06.431600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:06.434214 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:06.448821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:06.449741 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:06.451048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:06.451961 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:06.470378 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dcf69e7f-e53f-4a11-8a74-9a4be335a3a3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:06.491887 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-dcf69e7f-e53f-4a11-8a74-9a4be335a3a3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1709 microversion: 2.1 time: 0.361322 Jul 04 08:06:06.504208 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 147/303] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:06 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1709 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:07.279933 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-03f9a6d8-c43b-4549-9dff-0fcd24bb0744 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:07.280899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-03f9a6d8-c43b-4549-9dff-0fcd24bb0744 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:07.289510 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-03f9a6d8-c43b-4549-9dff-0fcd24bb0744 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:07.290435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-03f9a6d8-c43b-4549-9dff-0fcd24bb0744 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:07.291438 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-03f9a6d8-c43b-4549-9dff-0fcd24bb0744 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:07.292042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-03f9a6d8-c43b-4549-9dff-0fcd24bb0744 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:07.464197 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:07.506705 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:07.513302 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:07.518447 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ad88006d-ea0b-4996-af5d-1929578b2cd5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 1.094256 Jul 04 08:06:07.533656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 157/304] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:06 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:07.534243 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8c83b878-6ff6-4dde-9e6e-cc7781f89c56 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:07.535968 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8c83b878-6ff6-4dde-9e6e-cc7781f89c56 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:07.557561 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c83b878-6ff6-4dde-9e6e-cc7781f89c56 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:07.559000 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c83b878-6ff6-4dde-9e6e-cc7781f89c56 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:07.561147 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c83b878-6ff6-4dde-9e6e-cc7781f89c56 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:07.567352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c83b878-6ff6-4dde-9e6e-cc7781f89c56 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:07.651540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-03f9a6d8-c43b-4549-9dff-0fcd24bb0744 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:07.664584 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-03f9a6d8-c43b-4549-9dff-0fcd24bb0744 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.388642 Jul 04 08:06:07.666167 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 148/305] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:07 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:07.678021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-0d825aef-167a-4ca0-88cd-091d7a30d6bf req-c230a220-9e7e-4da9-a3e0-9d8ebaf3c831 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfe5154-5465-4c6b-a6c0-d41f8fcfb545", "tag": "151eb673-5017-4a41-910b-b1a450507544"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:07.701613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0d825aef-167a-4ca0-88cd-091d7a30d6bf req-c230a220-9e7e-4da9-a3e0-9d8ebaf3c831 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:07.702038 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-0d825aef-167a-4ca0-88cd-091d7a30d6bf req-c230a220-9e7e-4da9-a3e0-9d8ebaf3c831 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:07.739720 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-0d825aef-167a-4ca0-88cd-091d7a30d6bf req-c230a220-9e7e-4da9-a3e0-9d8ebaf3c831 service nova] Creating event network-changed:151eb673-5017-4a41-910b-b1a450507544 for instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 on hv-cinder-79760 Jul 04 08:06:07.764803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-0d825aef-167a-4ca0-88cd-091d7a30d6bf req-c230a220-9e7e-4da9-a3e0-9d8ebaf3c831 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095683 Jul 04 08:06:07.770143 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 149/306] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:06:07.926141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4906430c-4d52-4729-b714-2ccf467ac190 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "224a1a0e-ad36-4368-8982-33607cc9048d", "device": "/dev/sdb"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:07.928239 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4906430c-4d52-4729-b714-2ccf467ac190 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:07.947952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4906430c-4d52-4729-b714-2ccf467ac190 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:07.948923 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4906430c-4d52-4729-b714-2ccf467ac190 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:07.950437 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4906430c-4d52-4729-b714-2ccf467ac190 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:07.950955 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4906430c-4d52-4729-b714-2ccf467ac190 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:08.057851 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8c83b878-6ff6-4dde-9e6e-cc7781f89c56 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:08.067931 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8c83b878-6ff6-4dde-9e6e-cc7781f89c56 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1709 microversion: 2.1 time: 0.544641 Jul 04 08:06:08.068524 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 158/307] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:07 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1709 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:08.532045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4906430c-4d52-4729-b714-2ccf467ac190 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "POST /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.613789 Jul 04 08:06:08.544952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 150/308] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:06:07 2022] POST /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:06:08.547607 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:08.551111 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:08.574604 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:08.576473 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:08.584275 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:08.587151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:08.706018 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-98af3359-3a02-47f7-9ff5-83c214f0a0ab tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:08.708355 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-98af3359-3a02-47f7-9ff5-83c214f0a0ab tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:08.732963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-98af3359-3a02-47f7-9ff5-83c214f0a0ab tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:08.742254 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-98af3359-3a02-47f7-9ff5-83c214f0a0ab tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:08.746152 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-98af3359-3a02-47f7-9ff5-83c214f0a0ab tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:08.748348 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-98af3359-3a02-47f7-9ff5-83c214f0a0ab tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:09.050279 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-98af3359-3a02-47f7-9ff5-83c214f0a0ab tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:09.079508 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-98af3359-3a02-47f7-9ff5-83c214f0a0ab tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.387811 Jul 04 08:06:09.084775 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 151/309] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:08 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:09.109880 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c232a9e6-6111-4cca-81f4-783c5bdcd8b2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:09.111007 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c232a9e6-6111-4cca-81f4-783c5bdcd8b2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:09.132039 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c232a9e6-6111-4cca-81f4-783c5bdcd8b2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:09.132486 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c232a9e6-6111-4cca-81f4-783c5bdcd8b2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:09.133322 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c232a9e6-6111-4cca-81f4-783c5bdcd8b2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:09.133785 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c232a9e6-6111-4cca-81f4-783c5bdcd8b2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:09.425555 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c232a9e6-6111-4cca-81f4-783c5bdcd8b2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:09.452808 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c232a9e6-6111-4cca-81f4-783c5bdcd8b2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1709 microversion: 2.1 time: 0.366139 Jul 04 08:06:09.453965 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 152/310] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:09 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1709 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:09.568073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:09.587217 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:09.589276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:09.592085 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d14fdb74-388c-446c-b904-75d707dde13e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 1.049191 Jul 04 08:06:09.596560 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 159/311] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:08 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:10.102299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f17c8b4b-453a-4dbc-b809-bccc75ca21ce tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:10.104122 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f17c8b4b-453a-4dbc-b809-bccc75ca21ce tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:10.116173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f17c8b4b-453a-4dbc-b809-bccc75ca21ce tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:10.122479 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f17c8b4b-453a-4dbc-b809-bccc75ca21ce tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:10.123748 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f17c8b4b-453a-4dbc-b809-bccc75ca21ce tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:10.124342 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f17c8b4b-453a-4dbc-b809-bccc75ca21ce tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:10.406680 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f17c8b4b-453a-4dbc-b809-bccc75ca21ce tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:10.427103 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f17c8b4b-453a-4dbc-b809-bccc75ca21ce tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.328590 Jul 04 08:06:10.429087 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 153/312] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:10 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:10.472685 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ad9df761-9864-47fc-9005-82d4ee8050ea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:10.473311 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ad9df761-9864-47fc-9005-82d4ee8050ea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:10.481830 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad9df761-9864-47fc-9005-82d4ee8050ea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:10.482588 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad9df761-9864-47fc-9005-82d4ee8050ea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:10.483566 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad9df761-9864-47fc-9005-82d4ee8050ea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:10.484220 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad9df761-9864-47fc-9005-82d4ee8050ea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:10.613278 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:10.613967 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:10.620811 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:10.621171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:10.622000 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:10.622425 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:10.926880 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:10.942749 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:10.953180 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:10.956476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c75206fd-6eb1-4fd6-a589-7244ca57908d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.346865 Jul 04 08:06:10.957588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 154/313] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:10 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:11.031809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ad9df761-9864-47fc-9005-82d4ee8050ea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:11.038035 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:11.045259 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ad9df761-9864-47fc-9005-82d4ee8050ea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1709 microversion: 2.1 time: 0.578590 Jul 04 08:06:11.045904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 160/314] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:10 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1709 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:11.447455 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-276c09e5-8f32-4fd3-b4d0-aa966d7c3625 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:11.448612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-276c09e5-8f32-4fd3-b4d0-aa966d7c3625 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:11.464537 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-276c09e5-8f32-4fd3-b4d0-aa966d7c3625 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:11.465073 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-276c09e5-8f32-4fd3-b4d0-aa966d7c3625 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:11.466107 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-276c09e5-8f32-4fd3-b4d0-aa966d7c3625 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:11.466715 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-276c09e5-8f32-4fd3-b4d0-aa966d7c3625 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:11.866496 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-276c09e5-8f32-4fd3-b4d0-aa966d7c3625 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:11.877052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-276c09e5-8f32-4fd3-b4d0-aa966d7c3625 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.434667 Jul 04 08:06:11.891743 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 155/315] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:11 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:11.975730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:11.976490 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:11.992249 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:11.995700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:11.998265 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:11.998948 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:12.063902 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5b885c10-59a9-4991-8111-aa2929306b8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:12.064614 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5b885c10-59a9-4991-8111-aa2929306b8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:12.076479 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b885c10-59a9-4991-8111-aa2929306b8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:12.077067 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b885c10-59a9-4991-8111-aa2929306b8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:12.077966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b885c10-59a9-4991-8111-aa2929306b8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:12.078489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b885c10-59a9-4991-8111-aa2929306b8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:12.366612 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:12.375731 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:12.377638 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:12.379131 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ce6e188c-a43a-4290-b884-ca978ca4a729 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.408649 Jul 04 08:06:12.379889 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 161/316] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:11 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:12.591751 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5b885c10-59a9-4991-8111-aa2929306b8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:12.604031 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5b885c10-59a9-4991-8111-aa2929306b8a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1709 microversion: 2.1 time: 0.544280 Jul 04 08:06:12.606098 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 156/317] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:12 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1709 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:12.909438 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-eda67066-b314-4c45-a1b5-4cccdef5ec51 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:12.910289 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-eda67066-b314-4c45-a1b5-4cccdef5ec51 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:12.922331 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eda67066-b314-4c45-a1b5-4cccdef5ec51 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:12.922870 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eda67066-b314-4c45-a1b5-4cccdef5ec51 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:12.923890 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eda67066-b314-4c45-a1b5-4cccdef5ec51 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:12.924244 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eda67066-b314-4c45-a1b5-4cccdef5ec51 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:13.425998 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:13.430254 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:13.435361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-eda67066-b314-4c45-a1b5-4cccdef5ec51 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:13.459338 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-eda67066-b314-4c45-a1b5-4cccdef5ec51 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.553722 Jul 04 08:06:13.461122 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 162/318] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:12 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:13.463726 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:13.464765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:13.466432 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:13.469023 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:13.661732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1e03944c-c684-45ac-9d36-95756a4d54c8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:13.661732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1e03944c-c684-45ac-9d36-95756a4d54c8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:13.661732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e03944c-c684-45ac-9d36-95756a4d54c8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:13.661732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e03944c-c684-45ac-9d36-95756a4d54c8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:13.665092 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e03944c-c684-45ac-9d36-95756a4d54c8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:13.665092 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e03944c-c684-45ac-9d36-95756a4d54c8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:13.706588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:13.721377 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:13.723846 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:13.726643 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-39ac20f6-4019-4d6f-81a8-a56b7fd59847 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.314048 Jul 04 08:06:13.728119 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 157/319] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:13 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:13.965715 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1e03944c-c684-45ac-9d36-95756a4d54c8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:13.978501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1e03944c-c684-45ac-9d36-95756a4d54c8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1713 microversion: 2.1 time: 0.353805 Jul 04 08:06:13.993413 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 163/320] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:13 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1713 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:14.478949 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8936c3a8-9755-4d5a-a129-86987c0e0ccf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:14.479939 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8936c3a8-9755-4d5a-a129-86987c0e0ccf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:14.496982 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8936c3a8-9755-4d5a-a129-86987c0e0ccf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:14.500360 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8936c3a8-9755-4d5a-a129-86987c0e0ccf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:14.501663 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8936c3a8-9755-4d5a-a129-86987c0e0ccf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:14.504885 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8936c3a8-9755-4d5a-a129-86987c0e0ccf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:14.751567 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:14.752821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:14.782617 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:14.783127 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:14.787707 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:14.789901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:14.874020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8936c3a8-9755-4d5a-a129-86987c0e0ccf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:14.907705 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8936c3a8-9755-4d5a-a129-86987c0e0ccf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.420849 Jul 04 08:06:14.908399 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 158/321] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:14 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:15.200499 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:15.210531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:15.212317 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:15.223099 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-536c2625-8c07-44a7-9078-a16332efd9aa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.477292 Jul 04 08:06:15.237562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 164/322] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:14 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:15.927366 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d4c2d742-f7c4-4e78-b8d4-c32640da9293 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:15.927984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d4c2d742-f7c4-4e78-b8d4-c32640da9293 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:15.943474 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d4c2d742-f7c4-4e78-b8d4-c32640da9293 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:15.945114 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d4c2d742-f7c4-4e78-b8d4-c32640da9293 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:15.948237 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d4c2d742-f7c4-4e78-b8d4-c32640da9293 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:15.950354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d4c2d742-f7c4-4e78-b8d4-c32640da9293 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:16.249042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:16.249781 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:16.288579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:16.289027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:16.290030 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:16.290482 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:16.406139 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d4c2d742-f7c4-4e78-b8d4-c32640da9293 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:16.431802 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:16.444527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d4c2d742-f7c4-4e78-b8d4-c32640da9293 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.522458 Jul 04 08:06:16.460206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 159/323] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:15 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:16.575711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:16.595606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:16.598887 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:16.601683 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-955bab5c-1040-4ba8-91d6-e6523540887f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.358611 Jul 04 08:06:16.607733 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 165/324] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:16 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:17.480272 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d7257281-766f-49bb-90b3-c20c9df8134a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:17.481582 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d7257281-766f-49bb-90b3-c20c9df8134a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:17.498843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d7257281-766f-49bb-90b3-c20c9df8134a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:17.506099 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d7257281-766f-49bb-90b3-c20c9df8134a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:17.508054 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d7257281-766f-49bb-90b3-c20c9df8134a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:17.509104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d7257281-766f-49bb-90b3-c20c9df8134a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:17.641144 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:17.642592 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:17.664519 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:17.664951 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:17.666044 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:17.666623 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:17.965544 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:17.983871 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:17.998657 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:18.000560 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ab489cf3-568a-44d2-9a02-2bbe2674be3d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.370073 Jul 04 08:06:18.001802 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 166/325] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:17 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:18.096716 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d7257281-766f-49bb-90b3-c20c9df8134a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:18.145683 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d7257281-766f-49bb-90b3-c20c9df8134a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.664687 Jul 04 08:06:18.146375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 160/326] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:17 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:19.022242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:19.022881 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:19.040538 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:19.041288 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:19.042269 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:19.042845 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:19.164768 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9f847a38-f3c5-42e2-a45e-d641a7ea9813 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:19.165384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9f847a38-f3c5-42e2-a45e-d641a7ea9813 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:19.196343 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f847a38-f3c5-42e2-a45e-d641a7ea9813 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:19.196719 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f847a38-f3c5-42e2-a45e-d641a7ea9813 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:19.197507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f847a38-f3c5-42e2-a45e-d641a7ea9813 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:19.212659 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f847a38-f3c5-42e2-a45e-d641a7ea9813 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:19.476510 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9f847a38-f3c5-42e2-a45e-d641a7ea9813 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:19.486437 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9f847a38-f3c5-42e2-a45e-d641a7ea9813 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.326399 Jul 04 08:06:19.488796 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 161/327] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:19 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:19.541050 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:19.550101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:19.551629 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:19.552821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-68033c11-4335-4d32-9239-afffe2d03834 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.535459 Jul 04 08:06:19.575928 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 167/328] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:19 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:20.508702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8230cd1e-dab4-431e-8cf1-3f603357c0f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:20.515682 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8230cd1e-dab4-431e-8cf1-3f603357c0f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:20.526755 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8230cd1e-dab4-431e-8cf1-3f603357c0f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:20.527499 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8230cd1e-dab4-431e-8cf1-3f603357c0f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:20.528983 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8230cd1e-dab4-431e-8cf1-3f603357c0f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:20.530196 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8230cd1e-dab4-431e-8cf1-3f603357c0f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:20.608428 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:20.614760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:20.629609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:20.633526 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:20.635457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:20.636207 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:20.914910 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8230cd1e-dab4-431e-8cf1-3f603357c0f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:20.924660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8230cd1e-dab4-431e-8cf1-3f603357c0f0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1522 microversion: 2.1 time: 0.419787 Jul 04 08:06:20.928605 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 162/329] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:20 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:21.019177 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:21.037472 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:21.040337 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:21.041930 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-da5937fc-5bbb-4965-b406-759532fb8512 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.451045 Jul 04 08:06:21.042792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 168/330] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:20 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:21.911267 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e2be8b42-9c58-4aad-a7fd-b645e8e67ee2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Action: 'create', calling method: .version_select at 0x7f05e585c940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1224536609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/LGKiYJwHPPiI0S42j4J3T9qkRxfHR715P++oQ0Y4JvJwaMXAxBxj/dNdt80InGnOCxjxp8YJuZV0/Y1Qb1B8+9t418PUDN3kQUaeffePmIUz1Mb3Qx++WSeE21ER8UQ=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:21.926668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-e2be8b42-9c58-4aad-a7fd-b645e8e67ee2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Getting quotas for project 2609f0b160e0450798be03f7d3e993ad. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:06:21.930492 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-e2be8b42-9c58-4aad-a7fd-b645e8e67ee2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Getting quotas for user a860176540c64e6db269f9ebe4d75753 and project 2609f0b160e0450798be03f7d3e993ad. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:06:21.944593 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-41e0ed46-d798-44f2-ae62-6e749ec41f84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:21.945861 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-41e0ed46-d798-44f2-ae62-6e749ec41f84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:21.953271 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-41e0ed46-d798-44f2-ae62-6e749ec41f84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:21.953801 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-41e0ed46-d798-44f2-ae62-6e749ec41f84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:21.954760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-41e0ed46-d798-44f2-ae62-6e749ec41f84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:21.955344 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-41e0ed46-d798-44f2-ae62-6e749ec41f84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:21.963561 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e2be8b42-9c58-4aad-a7fd-b645e8e67ee2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.299084 Jul 04 08:06:21.964694 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 163/331] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:06:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:06:22.065692 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:22.066726 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:22.073614 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:22.074094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:22.074868 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:22.075290 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:22.159757 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-41e0ed46-d798-44f2-ae62-6e749ec41f84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:22.168971 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-41e0ed46-d798-44f2-ae62-6e749ec41f84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1502 microversion: 2.1 time: 0.228281 Jul 04 08:06:22.170009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 169/332] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:21 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1502 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:22.187737 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-491384ab-d48f-4862-93b3-dcda6a0c41f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:22.188685 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-491384ab-d48f-4862-93b3-dcda6a0c41f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:22.196950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-491384ab-d48f-4862-93b3-dcda6a0c41f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:22.197407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-491384ab-d48f-4862-93b3-dcda6a0c41f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:22.198254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-491384ab-d48f-4862-93b3-dcda6a0c41f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:22.199505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-491384ab-d48f-4862-93b3-dcda6a0c41f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:22.420206 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-491384ab-d48f-4862-93b3-dcda6a0c41f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:22.432068 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-491384ab-d48f-4862-93b3-dcda6a0c41f7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1514 microversion: 2.1 time: 0.248733 Jul 04 08:06:22.433530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 170/333] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:22 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:22.552370 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:22.562369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:22.564474 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:22.565949 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-813defd0-539d-443d-93e5-74dc3c574133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.504897 Jul 04 08:06:22.566622 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 164/334] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:22 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:23.585776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:23.586469 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:23.597534 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:23.598467 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:23.599520 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:23.600105 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:23.750925 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:23.766199 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:23.767792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:23.768962 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6b6655b2-cd75-4135-ab78-d73984737534 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.187924 Jul 04 08:06:23.769517 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 171/335] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:23 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:24.788431 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:24.788914 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:24.800805 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:24.802049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:24.803640 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:24.804375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:25.040256 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:25.053142 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:25.055339 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:25.056790 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-dda9181a-2977-49f6-973a-333bbfb40ba2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1741 microversion: 2.20 time: 0.272547 Jul 04 08:06:25.057747 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 165/336] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:24 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1741 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:26.047375 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8e7b221c-9657-47f5-9783-8dd6b9d07710 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:26.050467 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8e7b221c-9657-47f5-9783-8dd6b9d07710 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:26.058309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8e7b221c-9657-47f5-9783-8dd6b9d07710 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:26.059158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8e7b221c-9657-47f5-9783-8dd6b9d07710 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:26.060184 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8e7b221c-9657-47f5-9783-8dd6b9d07710 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:26.060842 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8e7b221c-9657-47f5-9783-8dd6b9d07710 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:26.081696 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:26.082319 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:26.092371 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:26.094454 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:26.095891 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:26.096660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:26.121088 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-8e7b221c-9657-47f5-9783-8dd6b9d07710 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'flavor' on Instance uuid 07d58cef-2712-485a-a46d-b96178458181 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:06:26.237888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8e7b221c-9657-47f5-9783-8dd6b9d07710 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181/action" status: 200 len: 32 microversion: 2.1 time: 0.188744 Jul 04 08:06:26.238704 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 172/337] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:06:26 2022] POST /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181/action => generated 32 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 08:06:26.249536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e59826df-5d51-4ee4-8f7b-94f1aefb49d2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:26.250376 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e59826df-5d51-4ee4-8f7b-94f1aefb49d2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:26.258184 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e59826df-5d51-4ee4-8f7b-94f1aefb49d2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:26.258896 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e59826df-5d51-4ee4-8f7b-94f1aefb49d2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:26.259788 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e59826df-5d51-4ee4-8f7b-94f1aefb49d2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:26.260376 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e59826df-5d51-4ee4-8f7b-94f1aefb49d2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:26.308973 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:26.326519 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:26.330421 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:26.333611 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8878900b-3929-479c-b1ce-5cb701c4a2a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1723 microversion: 2.20 time: 0.260919 Jul 04 08:06:26.335294 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 166/338] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:26 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:26.505245 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e59826df-5d51-4ee4-8f7b-94f1aefb49d2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:26.518053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e59826df-5d51-4ee4-8f7b-94f1aefb49d2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.273421 Jul 04 08:06:26.518995 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 173/339] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:26 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:27.365466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:27.366094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:27.372345 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:27.372787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:27.373543 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:27.373999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:27.545908 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9b4b1293-5b29-4adf-981f-5c58db77d830 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:27.546758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9b4b1293-5b29-4adf-981f-5c58db77d830 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:27.561594 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b4b1293-5b29-4adf-981f-5c58db77d830 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:27.562394 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b4b1293-5b29-4adf-981f-5c58db77d830 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:27.563938 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b4b1293-5b29-4adf-981f-5c58db77d830 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:27.565195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b4b1293-5b29-4adf-981f-5c58db77d830 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:27.613841 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:27.623248 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:27.624745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:27.626041 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e4cbe52b-2bee-4bb2-91c2-a10394d2dc7b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1723 microversion: 2.20 time: 0.265338 Jul 04 08:06:27.627837 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 167/340] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:27 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:27.716593 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9b4b1293-5b29-4adf-981f-5c58db77d830 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:27.725004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9b4b1293-5b29-4adf-981f-5c58db77d830 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.184028 Jul 04 08:06:27.734890 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 174/341] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:27 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:28.645906 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:28.646592 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:28.653899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:28.654371 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:28.655233 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:28.655713 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:28.743317 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-da99d10b-53e0-48c0-8782-9c4f470071de tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:28.745139 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-da99d10b-53e0-48c0-8782-9c4f470071de tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:28.753431 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da99d10b-53e0-48c0-8782-9c4f470071de tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:28.753942 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da99d10b-53e0-48c0-8782-9c4f470071de tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:28.754879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da99d10b-53e0-48c0-8782-9c4f470071de tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:28.755305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da99d10b-53e0-48c0-8782-9c4f470071de tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:28.776282 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:28.885230 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:28.898481 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:28.900015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:28.901448 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4a15b724-3c74-48ed-a6bb-1a12ddd2c021 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1723 microversion: 2.20 time: 0.260504 Jul 04 08:06:28.902223 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 168/342] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:28 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:28.945156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da99d10b-53e0-48c0-8782-9c4f470071de tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:28.957071 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-da99d10b-53e0-48c0-8782-9c4f470071de tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.217396 Jul 04 08:06:28.959043 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 175/343] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:28 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:29.666330 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-ffd629c2-a6fe-4a69-aa06-5be922b94906 req-90e9aa61-9e27-44ec-8e6b-0064cdd3fb9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42c331b-8c2a-4f37-bd0a-7221b07bf3af", "name": "network-vif-unplugged", "status": "completed", "tag": "624f3113-8fef-448f-b1f3-28db878c297b"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:29.678701 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-ffd629c2-a6fe-4a69-aa06-5be922b94906 req-90e9aa61-9e27-44ec-8e6b-0064cdd3fb9f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:29.679543 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-ffd629c2-a6fe-4a69-aa06-5be922b94906 req-90e9aa61-9e27-44ec-8e6b-0064cdd3fb9f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:29.700213 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-ffd629c2-a6fe-4a69-aa06-5be922b94906 req-90e9aa61-9e27-44ec-8e6b-0064cdd3fb9f service nova] Creating event network-vif-unplugged:624f3113-8fef-448f-b1f3-28db878c297b for instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af on hv-cinder-79760 Jul 04 08:06:29.707562 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-ffd629c2-a6fe-4a69-aa06-5be922b94906 req-90e9aa61-9e27-44ec-8e6b-0064cdd3fb9f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047336 Jul 04 08:06:29.708541 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 169/344] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:06:29.923628 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:29.926459 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:29.935993 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:29.936576 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:29.938071 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:29.938365 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:29.990846 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-15883172-684f-48f8-b654-c90c1a753b79 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:29.992318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-15883172-684f-48f8-b654-c90c1a753b79 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:30.010004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15883172-684f-48f8-b654-c90c1a753b79 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:30.011212 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15883172-684f-48f8-b654-c90c1a753b79 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:30.013357 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15883172-684f-48f8-b654-c90c1a753b79 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:30.014055 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-15883172-684f-48f8-b654-c90c1a753b79 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:30.101775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:30.120493 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:30.125550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:30.127055 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5b8fa417-3968-4e35-b590-18a6c212828f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1723 microversion: 2.20 time: 0.208777 Jul 04 08:06:30.128164 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 176/345] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:29 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:30.382211 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-15883172-684f-48f8-b654-c90c1a753b79 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:30.395299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-15883172-684f-48f8-b654-c90c1a753b79 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.418497 Jul 04 08:06:30.396694 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 170/346] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:29 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:31.148622 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:31.149452 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:31.166672 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:31.167487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:31.168333 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:31.168828 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:31.321041 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:31.330461 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:31.332037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:31.333658 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2e5f91e1-0588-4113-86fa-0a1e94d0de76 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1723 microversion: 2.20 time: 0.189861 Jul 04 08:06:31.334911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 177/347] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:31 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:31.414690 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-de875c29-f505-4ff8-ad52-4b68720395b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:31.415957 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-de875c29-f505-4ff8-ad52-4b68720395b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:31.427958 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-de875c29-f505-4ff8-ad52-4b68720395b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:31.428463 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-de875c29-f505-4ff8-ad52-4b68720395b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:31.429255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-de875c29-f505-4ff8-ad52-4b68720395b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:31.429891 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-de875c29-f505-4ff8-ad52-4b68720395b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:31.912580 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-de875c29-f505-4ff8-ad52-4b68720395b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:31.920822 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-de875c29-f505-4ff8-ad52-4b68720395b8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.510230 Jul 04 08:06:31.922002 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 171/348] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:31 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:32.361188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:32.362005 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:32.370274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:32.371502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:32.372939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:32.373742 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:32.529525 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:32.539986 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:32.541545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:32.543170 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d784f58c-7a62-433a-a509-6351b01d93ce tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1723 microversion: 2.20 time: 0.190879 Jul 04 08:06:32.543969 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 178/349] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:32 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:32.944969 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c0ca23b8-31a6-475e-bc99-295d29b0a8a0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:32.948038 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c0ca23b8-31a6-475e-bc99-295d29b0a8a0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:32.955590 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=4 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:32.965422 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0ca23b8-31a6-475e-bc99-295d29b0a8a0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:32.966264 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0ca23b8-31a6-475e-bc99-295d29b0a8a0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:32.967259 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0ca23b8-31a6-475e-bc99-295d29b0a8a0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:32.968024 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0ca23b8-31a6-475e-bc99-295d29b0a8a0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:33.346487 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c0ca23b8-31a6-475e-bc99-295d29b0a8a0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:33.363540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c0ca23b8-31a6-475e-bc99-295d29b0a8a0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.426351 Jul 04 08:06:33.365831 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 172/350] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:32 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:33.571392 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:33.572152 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:33.574954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=55 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:33.586313 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:33.587118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:33.588094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:33.588715 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:33.770811 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:33.779094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:33.780600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:33.781810 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bbe504bc-2b22-4358-895f-f04c71cf241b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1723 microversion: 2.20 time: 0.223365 Jul 04 08:06:33.782373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 179/351] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:33 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:34.390591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3fec77f4-af50-4c94-b2d0-2373a418002e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:34.391257 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3fec77f4-af50-4c94-b2d0-2373a418002e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:34.398040 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:34.399584 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3fec77f4-af50-4c94-b2d0-2373a418002e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:34.400023 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3fec77f4-af50-4c94-b2d0-2373a418002e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:34.411305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3fec77f4-af50-4c94-b2d0-2373a418002e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:34.414638 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3fec77f4-af50-4c94-b2d0-2373a418002e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:34.801532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:34.802262 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:34.822835 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:34.829734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:34.830837 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:34.831441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:34.860473 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3fec77f4-af50-4c94-b2d0-2373a418002e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:34.899440 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3fec77f4-af50-4c94-b2d0-2373a418002e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.510084 Jul 04 08:06:34.921032 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 173/352] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:34 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:35.163310 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:35.180536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:35.182815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:35.186616 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-006cf72c-aaaa-48bc-a000-4578d19222a3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1723 microversion: 2.20 time: 0.389794 Jul 04 08:06:35.188701 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 180/353] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:34 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1723 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:35.925060 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-32938f69-0819-44db-b9de-d22647d4a0a1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:35.926508 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-32938f69-0819-44db-b9de-d22647d4a0a1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:35.940403 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-32938f69-0819-44db-b9de-d22647d4a0a1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:35.942943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-32938f69-0819-44db-b9de-d22647d4a0a1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:35.945829 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-32938f69-0819-44db-b9de-d22647d4a0a1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:35.948491 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-32938f69-0819-44db-b9de-d22647d4a0a1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:36.208969 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:36.209701 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:36.231107 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:36.231824 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:36.232898 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:36.235044 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:36.306258 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-32938f69-0819-44db-b9de-d22647d4a0a1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:36.326379 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-32938f69-0819-44db-b9de-d22647d4a0a1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.405943 Jul 04 08:06:36.327636 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 174/354] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:35 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:36.573023 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:36.599909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:36.605405 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:36.607427 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-66d98cb4-fc4a-4978-a9c8-7671319a6da8 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1666 microversion: 2.20 time: 0.403604 Jul 04 08:06:36.608684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 181/355] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:36 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1666 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:36.628956 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a7d6751e-12c8-46ec-8499-d3df133e0197 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1298696-9b1d-4604-8479-a50d0e03bda5"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:36.630299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a7d6751e-12c8-46ec-8499-d3df133e0197 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:36.640444 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a7d6751e-12c8-46ec-8499-d3df133e0197 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:36.640899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a7d6751e-12c8-46ec-8499-d3df133e0197 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:36.641698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a7d6751e-12c8-46ec-8499-d3df133e0197 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:36.642139 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a7d6751e-12c8-46ec-8499-d3df133e0197 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:37.345900 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8181db52-9f8b-401a-bd3c-b6c725f00c73 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:37.348744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8181db52-9f8b-401a-bd3c-b6c725f00c73 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:37.357798 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:37.367976 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8181db52-9f8b-401a-bd3c-b6c725f00c73 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:37.369966 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8181db52-9f8b-401a-bd3c-b6c725f00c73 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:37.371281 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8181db52-9f8b-401a-bd3c-b6c725f00c73 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:37.378403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8181db52-9f8b-401a-bd3c-b6c725f00c73 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:37.379334 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a7d6751e-12c8-46ec-8499-d3df133e0197 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.755026 Jul 04 08:06:37.412454 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 175/356] 10.222.0.43 () {62 vars in 1363 bytes} [Mon Jul 4 08:06:36 2022] POST /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments => generated 188 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 08:06:37.635063 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3ffa1ed6-332f-45b8-ae98-24419db8a13c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:37.635751 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3ffa1ed6-332f-45b8-ae98-24419db8a13c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:37.644066 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ffa1ed6-332f-45b8-ae98-24419db8a13c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:37.644740 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ffa1ed6-332f-45b8-ae98-24419db8a13c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:37.646136 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ffa1ed6-332f-45b8-ae98-24419db8a13c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:37.646980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3ffa1ed6-332f-45b8-ae98-24419db8a13c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:37.738677 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8181db52-9f8b-401a-bd3c-b6c725f00c73 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:37.749570 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8181db52-9f8b-401a-bd3c-b6c725f00c73 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.408430 Jul 04 08:06:37.765814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 182/357] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:37 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:37.894183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3ffa1ed6-332f-45b8-ae98-24419db8a13c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/action" status: 202 len: 0 microversion: 2.20 time: 0.263256 Jul 04 08:06:37.898901 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 176/358] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Jul 4 08:06:37 2022] POST /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 04 08:06:37.904929 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:37.905948 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:37.914453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:37.914985 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:37.915746 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:37.916438 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:38.313738 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:38.329293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:38.331185 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:38.332821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6c342b3d-eec3-4a8a-8e63-79303d812730 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1752 microversion: 2.20 time: 0.432046 Jul 04 08:06:38.333444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 183/359] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:37 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1752 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:38.639049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-37071e38-ad90-4e09-b62c-2b782382f451 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:38.639864 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-37071e38-ad90-4e09-b62c-2b782382f451 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:38.651795 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37071e38-ad90-4e09-b62c-2b782382f451 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:38.652490 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37071e38-ad90-4e09-b62c-2b782382f451 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:38.653480 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37071e38-ad90-4e09-b62c-2b782382f451 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:38.654925 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37071e38-ad90-4e09-b62c-2b782382f451 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:38.770923 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5be46724-fe18-4719-a139-90d931b85f49 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:38.771536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5be46724-fe18-4719-a139-90d931b85f49 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:38.797374 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5be46724-fe18-4719-a139-90d931b85f49 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:38.797873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5be46724-fe18-4719-a139-90d931b85f49 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:38.798667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5be46724-fe18-4719-a139-90d931b85f49 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:38.799101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5be46724-fe18-4719-a139-90d931b85f49 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:39.070086 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-37071e38-ad90-4e09-b62c-2b782382f451 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lazy-loading 'services' on Instance uuid 25c989c0-8d21-40d1-bc9d-9d5010bc6378 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:06:39.246001 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5be46724-fe18-4719-a139-90d931b85f49 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:39.261563 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5be46724-fe18-4719-a139-90d931b85f49 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.492255 Jul 04 08:06:39.274112 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 184/360] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:38 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:39.335922 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-37071e38-ad90-4e09-b62c-2b782382f451 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "DELETE /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378/os-volume_attachments/224a1a0e-ad36-4368-8982-33607cc9048d" status: 202 len: 0 microversion: 2.1 time: 0.703070 Jul 04 08:06:39.336535 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 177/361] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:06:38 2022] DELETE /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378/os-volume_attachments/224a1a0e-ad36-4368-8982-33607cc9048d => generated 0 bytes in 705 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:06:39.358580 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:39.359165 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:39.377685 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:39.378207 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:39.383498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:39.383947 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:39.914760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:39.928387 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:39.930392 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:39.931874 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a9da669c-dd13-4c47-847c-4c9b2146386e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1752 microversion: 2.20 time: 0.579357 Jul 04 08:06:39.933130 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 185/362] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:39 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1752 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:40.294445 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-238c2c1c-dd1c-41ef-a9fe-8890e243dc04 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:40.295300 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-238c2c1c-dd1c-41ef-a9fe-8890e243dc04 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:40.308642 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-238c2c1c-dd1c-41ef-a9fe-8890e243dc04 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:40.309591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-238c2c1c-dd1c-41ef-a9fe-8890e243dc04 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:40.310876 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-238c2c1c-dd1c-41ef-a9fe-8890e243dc04 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:40.311558 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-238c2c1c-dd1c-41ef-a9fe-8890e243dc04 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:40.586185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-238c2c1c-dd1c-41ef-a9fe-8890e243dc04 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:40.596564 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-238c2c1c-dd1c-41ef-a9fe-8890e243dc04 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.306940 Jul 04 08:06:40.614045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 178/363] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:40 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:40.952437 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:40.953730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:40.961809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:40.962370 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:40.963405 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:40.963891 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:41.209175 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:41.223958 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:41.225515 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:41.227394 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3c45a094-f5c3-4dff-bf63-fddd884de1c0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1754 microversion: 2.20 time: 0.279629 Jul 04 08:06:41.227956 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 186/364] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:40 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1754 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:41.620591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2c14c812-0bc9-4b3f-83e9-443129a28e83 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:41.621507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2c14c812-0bc9-4b3f-83e9-443129a28e83 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:41.631592 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c14c812-0bc9-4b3f-83e9-443129a28e83 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:41.636344 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c14c812-0bc9-4b3f-83e9-443129a28e83 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:41.639153 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c14c812-0bc9-4b3f-83e9-443129a28e83 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:41.640142 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c14c812-0bc9-4b3f-83e9-443129a28e83 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:41.774776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2dd6f09c-b40c-4545-89f5-a86729bcb268 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:41.776174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2dd6f09c-b40c-4545-89f5-a86729bcb268 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:41.794598 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2dd6f09c-b40c-4545-89f5-a86729bcb268 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:41.796192 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2dd6f09c-b40c-4545-89f5-a86729bcb268 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:41.798505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2dd6f09c-b40c-4545-89f5-a86729bcb268 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:41.799803 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2dd6f09c-b40c-4545-89f5-a86729bcb268 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:41.870825 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2dd6f09c-b40c-4545-89f5-a86729bcb268 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:06:41.992314 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2c14c812-0bc9-4b3f-83e9-443129a28e83 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:42.002645 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2c14c812-0bc9-4b3f-83e9-443129a28e83 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.385373 Jul 04 08:06:42.003197 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 179/365] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:41 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:42.096452 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2dd6f09c-b40c-4545-89f5-a86729bcb268 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "DELETE /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 204 len: 0 microversion: 2.1 time: 0.329418 Jul 04 08:06:42.097252 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 187/366] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:06:41 2022] DELETE /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:06:42.108959 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-69ea5775-e4ae-4ddf-baf8-a78888b512c4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:42.110159 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-69ea5775-e4ae-4ddf-baf8-a78888b512c4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:42.123916 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69ea5775-e4ae-4ddf-baf8-a78888b512c4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:42.124556 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69ea5775-e4ae-4ddf-baf8-a78888b512c4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:42.125528 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69ea5775-e4ae-4ddf-baf8-a78888b512c4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:42.126127 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69ea5775-e4ae-4ddf-baf8-a78888b512c4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:42.293539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cc3114e6-b287-46be-ae5b-7288d6644cf5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Action: 'create', calling method: .version_select at 0x7f05e585cf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1698566224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlCTn4cuojcdU6SnAfYGxnnAOrTy0ujIdGfJ4VSjjFqLhRdtBIkpg1Ar8gtlVtYGibo1HlQ/5Gd3v0MzXF7ImdiS/bwZRZMGvDRvusTQ/KpAoE5aqss4JHWIaH3819pJw=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:42.318714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-cc3114e6-b287-46be-ae5b-7288d6644cf5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Getting quotas for project d1b0f9c7bc044f6c802c8cd34da4eb0e. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:06:42.326653 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-cc3114e6-b287-46be-ae5b-7288d6644cf5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Getting quotas for user fa28f0e0b3b0488faf7db7bf7dc3854b and project d1b0f9c7bc044f6c802c8cd34da4eb0e. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:06:42.332498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-69ea5775-e4ae-4ddf-baf8-a78888b512c4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:42.347909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-69ea5775-e4ae-4ddf-baf8-a78888b512c4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1513 microversion: 2.1 time: 0.243610 Jul 04 08:06:42.349556 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 188/367] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:42 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:42.357466 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:42.359168 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:42.369057 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:42.370072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:42.371031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:42.371723 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:42.380107 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cc3114e6-b287-46be-ae5b-7288d6644cf5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.293088 Jul 04 08:06:42.380925 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 180/368] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:06:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:06:42.602951 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:42.628146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:42.631440 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:42.633682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-aa9d1447-e678-4611-9462-b26b6031ccaa tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.282021 Jul 04 08:06:42.646867 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 189/369] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:42 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:43.023321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f3a20e18-8ce9-4783-883d-4808eb745d7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:43.034531 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f3a20e18-8ce9-4783-883d-4808eb745d7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:43.042201 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3a20e18-8ce9-4783-883d-4808eb745d7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:43.042648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3a20e18-8ce9-4783-883d-4808eb745d7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:43.043717 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3a20e18-8ce9-4783-883d-4808eb745d7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:43.044398 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f3a20e18-8ce9-4783-883d-4808eb745d7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:43.251529 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f3a20e18-8ce9-4783-883d-4808eb745d7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:43.262259 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f3a20e18-8ce9-4783-883d-4808eb745d7a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.245228 Jul 04 08:06:43.262900 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 181/370] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:43 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:43.370860 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4f30d83e-57d9-43ed-bbfe-044a398a4eb5 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:43.372950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4f30d83e-57d9-43ed-bbfe-044a398a4eb5 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:43.392069 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f30d83e-57d9-43ed-bbfe-044a398a4eb5 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:43.394573 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f30d83e-57d9-43ed-bbfe-044a398a4eb5 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:43.395875 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f30d83e-57d9-43ed-bbfe-044a398a4eb5 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:43.396628 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f30d83e-57d9-43ed-bbfe-044a398a4eb5 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:43.429204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:43.630701 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4f30d83e-57d9-43ed-bbfe-044a398a4eb5 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:43.658946 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:43.660344 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:43.664933 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4f30d83e-57d9-43ed-bbfe-044a398a4eb5 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1513 microversion: 2.1 time: 0.300220 Jul 04 08:06:43.667179 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 190/371] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:43 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1513 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:43.674944 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:43.675857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:43.677122 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:43.677792 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:43.966477 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:43.978881 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:43.981132 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:43.982849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a6c0d3cc-92d8-401a-af48-a6c920a17bb9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.327887 Jul 04 08:06:43.994544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 182/372] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:43 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:44.289139 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-79be4174-a044-48a8-b7fd-64cc0411d54e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:44.290360 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-79be4174-a044-48a8-b7fd-64cc0411d54e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:44.298988 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79be4174-a044-48a8-b7fd-64cc0411d54e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:44.305196 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79be4174-a044-48a8-b7fd-64cc0411d54e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:44.310333 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79be4174-a044-48a8-b7fd-64cc0411d54e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:44.311678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79be4174-a044-48a8-b7fd-64cc0411d54e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:44.536510 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-79be4174-a044-48a8-b7fd-64cc0411d54e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:44.546199 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-79be4174-a044-48a8-b7fd-64cc0411d54e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.260179 Jul 04 08:06:44.547280 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 191/373] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:44 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:44.685315 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e5faf3a3-46ad-4ea7-9e19-1cfd60fe514d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:44.686253 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e5faf3a3-46ad-4ea7-9e19-1cfd60fe514d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:44.700962 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5faf3a3-46ad-4ea7-9e19-1cfd60fe514d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:44.701714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5faf3a3-46ad-4ea7-9e19-1cfd60fe514d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:44.702510 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5faf3a3-46ad-4ea7-9e19-1cfd60fe514d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:44.704755 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e5faf3a3-46ad-4ea7-9e19-1cfd60fe514d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:45.011813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:45.012801 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:45.037356 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:45.037853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:45.038679 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:45.039108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:45.180977 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e5faf3a3-46ad-4ea7-9e19-1cfd60fe514d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:45.204495 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e5faf3a3-46ad-4ea7-9e19-1cfd60fe514d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1513 microversion: 2.1 time: 0.524314 Jul 04 08:06:45.205433 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 183/374] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:44 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1513 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:45.499009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1262642642", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1224536609", "security_groups": [{"name": "tempest-secgroup-smoke-1481567082"}], "networks": [{"uuid": "c1bd6cae-906c-463a-826f-932e77f56cc0"}], "block_device_mapping_v2": [{"uuid": "d789f1d0-1189-4716-bf51-7e70f6935e73", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:45.578485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:45.594736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:45.598811 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:45.602167 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ecc4cdd5-ac13-4d23-b764-f00ce297e1ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.602854 Jul 04 08:06:45.605959 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 192/375] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:44 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:45.619957 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4f1bd7a3-65b0-49f7-a0a0-98e4d405b780 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:45.621022 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4f1bd7a3-65b0-49f7-a0a0-98e4d405b780 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:45.633201 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f1bd7a3-65b0-49f7-a0a0-98e4d405b780 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:45.633667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f1bd7a3-65b0-49f7-a0a0-98e4d405b780 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:45.634455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f1bd7a3-65b0-49f7-a0a0-98e4d405b780 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:45.634879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f1bd7a3-65b0-49f7-a0a0-98e4d405b780 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:45.916747 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4f1bd7a3-65b0-49f7-a0a0-98e4d405b780 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:45.931592 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4f1bd7a3-65b0-49f7-a0a0-98e4d405b780 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.319403 Jul 04 08:06:45.933152 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 193/376] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:45 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:45.971815 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] validate_networks() for [('c1bd6cae-906c-463a-826f-932e77f56cc0', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:06:46.236402 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c83782b0-07f5-460a-a4d4-5e323b17361d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:46.236947 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c83782b0-07f5-460a-a4d4-5e323b17361d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:46.245177 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c83782b0-07f5-460a-a4d4-5e323b17361d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:46.245657 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c83782b0-07f5-460a-a4d4-5e323b17361d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:46.246497 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c83782b0-07f5-460a-a4d4-5e323b17361d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:46.246928 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c83782b0-07f5-460a-a4d4-5e323b17361d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:46.459824 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c83782b0-07f5-460a-a4d4-5e323b17361d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:46.470601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c83782b0-07f5-460a-a4d4-5e323b17361d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1513 microversion: 2.1 time: 0.242030 Jul 04 08:06:46.471946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 194/377] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:46 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:46.649279 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:46.650660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:46.673598 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:46.674262 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:46.676118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:46.676118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:46.975571 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:46.992689 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:46.994428 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:46.996107 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-723d6e4b-9925-44ae-aa56-27ab26d25a38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.353324 Jul 04 08:06:46.996924 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 195/378] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:46 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:47.010093 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-63940ab9-7c05-483b-80bf-2cfde35eb7e7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:47.010995 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-63940ab9-7c05-483b-80bf-2cfde35eb7e7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:47.019094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63940ab9-7c05-483b-80bf-2cfde35eb7e7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:47.019887 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63940ab9-7c05-483b-80bf-2cfde35eb7e7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:47.020734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63940ab9-7c05-483b-80bf-2cfde35eb7e7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:47.021168 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63940ab9-7c05-483b-80bf-2cfde35eb7e7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:47.224986 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-63940ab9-7c05-483b-80bf-2cfde35eb7e7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:47.239950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-63940ab9-7c05-483b-80bf-2cfde35eb7e7 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.241420 Jul 04 08:06:47.240815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 196/379] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:46 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:47.251838 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-5ad70112-0d7f-4d78-a156-c8fc97937c58 req-675a86eb-16ba-4f28-ac51-6bb326d98aff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c989c0-8d21-40d1-bc9d-9d5010bc6378", "name": "network-vif-deleted", "tag": "73d4fae8-2faf-42dd-99fc-e6b6beee5ee6"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:47.263563 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-5ad70112-0d7f-4d78-a156-c8fc97937c58 req-675a86eb-16ba-4f28-ac51-6bb326d98aff service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:47.264439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-5ad70112-0d7f-4d78-a156-c8fc97937c58 req-675a86eb-16ba-4f28-ac51-6bb326d98aff service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:47.285260 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-5ad70112-0d7f-4d78-a156-c8fc97937c58 req-675a86eb-16ba-4f28-ac51-6bb326d98aff service nova] Creating event network-vif-deleted:73d4fae8-2faf-42dd-99fc-e6b6beee5ee6 for instance 25c989c0-8d21-40d1-bc9d-9d5010bc6378 on hv-cinder-79760 Jul 04 08:06:47.292788 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-5ad70112-0d7f-4d78-a156-c8fc97937c58 req-675a86eb-16ba-4f28-ac51-6bb326d98aff service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044735 Jul 04 08:06:47.293967 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 197/380] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:06:47.340306 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:06:47.341181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:06:47.342698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:06:47.343725 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:06:47.344658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:06:47.366096 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:47.366544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:47.367571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:47.368181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:47.393842 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Getting quotas for project 2609f0b160e0450798be03f7d3e993ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:06:47.399398 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Getting quotas for user a860176540c64e6db269f9ebe4d75753 and project 2609f0b160e0450798be03f7d3e993ad. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:06:47.484759 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:06:47.487231 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d789f1d0-1189-4716-bf51-7e70f6935e73',volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:06:47.497761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:47.498823 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:47.509573 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:47.510162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:47.511033 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:47.511559 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:47.557250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:47.557736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:47.558193 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lazy-loading 'fault' on Instance uuid 25c989c0-8d21-40d1-bc9d-9d5010bc6378 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:06:47.619761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:47.629167 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8343ea74-b46c-4c21-832b-88bf55782271 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 200 len: 1308 microversion: 2.1 time: 0.136482 Jul 04 08:06:47.633720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 198/381] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:47 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 1308 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:47.701576 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-acb86fac-70b2-4870-ac27-1fccdd05d6ff tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.214658 Jul 04 08:06:47.702266 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 184/382] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:06:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 2217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:06:47.720641 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-caa41c83-f466-4fea-bfc5-ae1cb3a5dc25 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:47.721731 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-caa41c83-f466-4fea-bfc5-ae1cb3a5dc25 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:47.807518 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-caa41c83-f466-4fea-bfc5-ae1cb3a5dc25 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:47.821274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-caa41c83-f466-4fea-bfc5-ae1cb3a5dc25 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1089 microversion: 2.1 time: 0.108467 Jul 04 08:06:47.831241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 199/383] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:47 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1089 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:48.028253 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:48.029238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:48.041257 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:48.042434 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:48.044122 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:48.045094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:48.261689 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ef16a1f3-183c-49df-bbd1-188741f3b81f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:48.263339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ef16a1f3-183c-49df-bbd1-188741f3b81f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:48.277305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ef16a1f3-183c-49df-bbd1-188741f3b81f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:48.279812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ef16a1f3-183c-49df-bbd1-188741f3b81f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:48.281485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ef16a1f3-183c-49df-bbd1-188741f3b81f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:48.283133 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ef16a1f3-183c-49df-bbd1-188741f3b81f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:48.352041 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:48.369000 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:48.372869 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:48.375438 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e9f12f57-aa9c-4045-b770-4a24f68c138b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.354001 Jul 04 08:06:48.381392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 185/384] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:48 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:48.510340 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ef16a1f3-183c-49df-bbd1-188741f3b81f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:48.524915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ef16a1f3-183c-49df-bbd1-188741f3b81f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.269455 Jul 04 08:06:48.526815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 200/385] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:48 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:48.656298 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:48.659341 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 25c989c0-8d21-40d1-bc9d-9d5010bc6378] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:48.684991 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:48.687419 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:48.691724 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:48.693086 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:48.753296 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] HTTP exception thrown: Instance 25c989c0-8d21-40d1-bc9d-9d5010bc6378 could not be found. Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Request method failure captured: Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 HTTP/1.1 Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp9DDKUVmio69_HR0f_U2jjG6iPIj1tiltm_kB9JNsoGA1r4HaDBl5K5Q_HyK8T5iQARgTzAEgzGA3sbESzeLFKKEOBxuuNVOc3RBg4mgrRrIFFKkcGwGMCVnvG0qpV_MGEaAUBUQ1_oEFatRMgdQ9iYmoOmKf5LkXlp-JvcezsUf6g Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 6de1b2d9c55f4af7b6793ac472a6d408 Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesSnapshotTestJSON-383634651 Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:06:48.771721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6de1b2d9c55f4af7b6793ac472a6d408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6de1b2d9c55f4af7b6793ac472a6d408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6de1b2d9c55f4af7b6793ac472a6d408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6de1b2d9c55f4af7b6793ac472a6d408", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesSnapshotTestJSON-383634651 Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 6de1b2d9c55f4af7b6793ac472a6d408 Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-383634651 Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesSnapshotTestJSON-383634651-project Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 34b2b4070d344d7ca07a99985678467a Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesSnapshotTestJSON-383634651-project Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 25c989c0-8d21-40d1-bc9d-9d5010bc6378 could not be found. Jul 04 08:06:48.774326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '25c989c0-8d21-40d1-bc9d-9d5010bc6378'} Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c989c0-8d21-40d1-bc9d-9d5010bc6378 could not be found. Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:06:48.775665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c989c0-8d21-40d1-bc9d-9d5010bc6378 could not be found. Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c989c0-8d21-40d1-bc9d-9d5010bc6378 could not be found. Jul 04 08:06:48.778001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:06:48.779991 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Returning 404 to user: Instance 25c989c0-8d21-40d1-bc9d-9d5010bc6378 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:06:48.781376 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a2f36af8-d01a-4689-b06f-1e0f49974c45 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378" status: 404 len: 111 microversion: 2.1 time: 0.130076 Jul 04 08:06:48.782358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 186/386] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:48 2022] GET /compute/v2.1/servers/25c989c0-8d21-40d1-bc9d-9d5010bc6378 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 08:06:48.843206 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-be886ec1-1dbc-49cf-b46c-a06a4fcf3145 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:48.844293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-be886ec1-1dbc-49cf-b46c-a06a4fcf3145 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:48.858401 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be886ec1-1dbc-49cf-b46c-a06a4fcf3145 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:48.859181 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be886ec1-1dbc-49cf-b46c-a06a4fcf3145 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:48.862062 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be886ec1-1dbc-49cf-b46c-a06a4fcf3145 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:48.863100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be886ec1-1dbc-49cf-b46c-a06a4fcf3145 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:48.987375 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-be886ec1-1dbc-49cf-b46c-a06a4fcf3145 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:49.000974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-be886ec1-1dbc-49cf-b46c-a06a4fcf3145 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1187 microversion: 2.1 time: 0.164870 Jul 04 08:06:49.013937 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 201/387] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:48 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1187 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:49.406666 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:49.409039 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:49.423902 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:49.425836 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:49.427880 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:49.428996 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:49.570590 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e10e13cd-f152-4434-9dad-0a0c5ade7de0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:49.571915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e10e13cd-f152-4434-9dad-0a0c5ade7de0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:49.622049 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e10e13cd-f152-4434-9dad-0a0c5ade7de0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:49.622818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e10e13cd-f152-4434-9dad-0a0c5ade7de0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:49.624177 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e10e13cd-f152-4434-9dad-0a0c5ade7de0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:49.631188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e10e13cd-f152-4434-9dad-0a0c5ade7de0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:49.813379 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:49.864769 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:49.868980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:49.871259 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-08ffa1b0-d3c8-4afd-ae5d-7dc27059b8bc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.473153 Jul 04 08:06:49.872426 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 187/388] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:49 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:49.970662 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e10e13cd-f152-4434-9dad-0a0c5ade7de0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:49.979590 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e10e13cd-f152-4434-9dad-0a0c5ade7de0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.435303 Jul 04 08:06:49.980194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 202/389] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:49 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:50.026734 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-48814908-f8d5-4b89-92cf-759b05ca7afe tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:50.027864 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-48814908-f8d5-4b89-92cf-759b05ca7afe tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:50.041171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-48814908-f8d5-4b89-92cf-759b05ca7afe tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:50.041990 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-48814908-f8d5-4b89-92cf-759b05ca7afe tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:50.043720 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-48814908-f8d5-4b89-92cf-759b05ca7afe tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:50.044710 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-48814908-f8d5-4b89-92cf-759b05ca7afe tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:50.176723 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-48814908-f8d5-4b89-92cf-759b05ca7afe tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:50.211101 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-48814908-f8d5-4b89-92cf-759b05ca7afe tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1187 microversion: 2.1 time: 0.194313 Jul 04 08:06:50.212612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 188/390] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:50 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1187 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:50.902245 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:50.902867 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:50.911134 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:50.911578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:50.912504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:50.912859 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:51.011210 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b083e8b4-981c-4247-b3ef-93475cb29687 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:51.013534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b083e8b4-981c-4247-b3ef-93475cb29687 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:51.029879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b083e8b4-981c-4247-b3ef-93475cb29687 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:51.030772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b083e8b4-981c-4247-b3ef-93475cb29687 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:51.033122 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b083e8b4-981c-4247-b3ef-93475cb29687 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:51.034071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b083e8b4-981c-4247-b3ef-93475cb29687 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:51.251051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:51.262284 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:51.265044 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:51.266640 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bef47f4b-e597-44a8-b905-91bbf0608010 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.369026 Jul 04 08:06:51.267818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 203/391] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:50 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:51.292142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2c7efdea-4211-49e8-807b-a176cc849f71 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:51.292785 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2c7efdea-4211-49e8-807b-a176cc849f71 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:51.300497 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c7efdea-4211-49e8-807b-a176cc849f71 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:51.301124 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c7efdea-4211-49e8-807b-a176cc849f71 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:51.302524 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c7efdea-4211-49e8-807b-a176cc849f71 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:51.302967 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c7efdea-4211-49e8-807b-a176cc849f71 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:51.400178 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2c7efdea-4211-49e8-807b-a176cc849f71 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:51.402960 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b083e8b4-981c-4247-b3ef-93475cb29687 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:51.413098 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b083e8b4-981c-4247-b3ef-93475cb29687 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.410650 Jul 04 08:06:51.416464 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 189/392] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:51 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:51.424325 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2c7efdea-4211-49e8-807b-a176cc849f71 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1187 microversion: 2.1 time: 0.154262 Jul 04 08:06:51.426390 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 204/393] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:51 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1187 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:52.307385 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:52.309758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:52.325349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:52.326126 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:52.327500 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:52.328232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:52.444032 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e552dba6-33ca-4e65-843c-ced3d3994417 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:52.444981 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e552dba6-33ca-4e65-843c-ced3d3994417 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:52.454835 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e552dba6-33ca-4e65-843c-ced3d3994417 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:52.455588 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e552dba6-33ca-4e65-843c-ced3d3994417 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:52.456806 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e552dba6-33ca-4e65-843c-ced3d3994417 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:52.457521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e552dba6-33ca-4e65-843c-ced3d3994417 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:52.578085 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:52.601867 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:52.610453 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:52.613544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-71e00978-3325-4f56-b517-50772ca9cac9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.313859 Jul 04 08:06:52.614644 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 190/394] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:52 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:52.629907 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0c56bb14-22ba-495a-acf1-6d9c93608e98 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:52.630867 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0c56bb14-22ba-495a-acf1-6d9c93608e98 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:52.645886 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c56bb14-22ba-495a-acf1-6d9c93608e98 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:52.646452 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c56bb14-22ba-495a-acf1-6d9c93608e98 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:52.647351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c56bb14-22ba-495a-acf1-6d9c93608e98 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:52.647879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c56bb14-22ba-495a-acf1-6d9c93608e98 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:52.684128 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e552dba6-33ca-4e65-843c-ced3d3994417 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:52.692871 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e552dba6-33ca-4e65-843c-ced3d3994417 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.254456 Jul 04 08:06:52.693469 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 205/395] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:52 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:52.720828 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0c56bb14-22ba-495a-acf1-6d9c93608e98 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:52.729569 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0c56bb14-22ba-495a-acf1-6d9c93608e98 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1187 microversion: 2.1 time: 0.113775 Jul 04 08:06:52.730201 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 191/396] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:52 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1187 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:53.636002 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:53.636627 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:53.650867 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:53.651322 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:53.652146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:53.652598 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:53.712216 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c07b608e-6b28-46d0-87cf-4aa9fab896d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:53.713090 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c07b608e-6b28-46d0-87cf-4aa9fab896d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:53.725701 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c07b608e-6b28-46d0-87cf-4aa9fab896d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:53.726166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c07b608e-6b28-46d0-87cf-4aa9fab896d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:53.726990 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c07b608e-6b28-46d0-87cf-4aa9fab896d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:53.727426 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c07b608e-6b28-46d0-87cf-4aa9fab896d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:53.901599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:53.914601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:53.917530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:53.919296 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-be509dc2-6c24-4324-87c2-807fad2c48ff tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.287465 Jul 04 08:06:53.921114 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 206/397] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:53 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:53.927858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab60c388-be66-4ab1-a95d-3f44fc536a73 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:53.928489 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ab60c388-be66-4ab1-a95d-3f44fc536a73 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:53.936235 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab60c388-be66-4ab1-a95d-3f44fc536a73 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:53.936676 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab60c388-be66-4ab1-a95d-3f44fc536a73 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:53.937474 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab60c388-be66-4ab1-a95d-3f44fc536a73 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:53.938021 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab60c388-be66-4ab1-a95d-3f44fc536a73 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:54.004293 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c07b608e-6b28-46d0-87cf-4aa9fab896d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:54.008281 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:54.013509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c07b608e-6b28-46d0-87cf-4aa9fab896d5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.305250 Jul 04 08:06:54.021953 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 192/398] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:53 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:54.074186 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ab60c388-be66-4ab1-a95d-3f44fc536a73 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:54.090424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ab60c388-be66-4ab1-a95d-3f44fc536a73 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1187 microversion: 2.1 time: 0.167323 Jul 04 08:06:54.091961 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 207/399] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:53 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1187 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:54.940548 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:54.942266 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:54.959952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:54.961005 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:54.962045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:54.962793 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:55.031775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9a81483e-2c30-4424-9cce-295ea33f5b5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:55.033169 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9a81483e-2c30-4424-9cce-295ea33f5b5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:55.049086 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9a81483e-2c30-4424-9cce-295ea33f5b5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:55.050776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9a81483e-2c30-4424-9cce-295ea33f5b5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:55.054597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9a81483e-2c30-4424-9cce-295ea33f5b5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:55.057408 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9a81483e-2c30-4424-9cce-295ea33f5b5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:55.150454 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:55.375312 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9a81483e-2c30-4424-9cce-295ea33f5b5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:55.386332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:55.404149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9a81483e-2c30-4424-9cce-295ea33f5b5b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.376336 Jul 04 08:06:55.404965 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 208/400] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:55 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:06:55.407805 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:55.410598 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:55.412853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-96d2f82f-3c9d-4e86-88d4-2ec5bf442917 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.477148 Jul 04 08:06:55.414438 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 193/401] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:54 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:55.427169 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b380b39f-3f67-43a3-8af0-02ccfdf287f1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:55.428169 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b380b39f-3f67-43a3-8af0-02ccfdf287f1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:55.435903 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b380b39f-3f67-43a3-8af0-02ccfdf287f1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:55.436345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b380b39f-3f67-43a3-8af0-02ccfdf287f1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:55.437132 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b380b39f-3f67-43a3-8af0-02ccfdf287f1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:55.437548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b380b39f-3f67-43a3-8af0-02ccfdf287f1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:55.607698 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b380b39f-3f67-43a3-8af0-02ccfdf287f1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:55.625143 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b380b39f-3f67-43a3-8af0-02ccfdf287f1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1187 microversion: 2.1 time: 0.218921 Jul 04 08:06:55.637704 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 209/402] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:55 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1187 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:56.431764 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a690a4f5-ff06-4f7b-8c51-9b9ef2738f15 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:56.432481 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a690a4f5-ff06-4f7b-8c51-9b9ef2738f15 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:56.445791 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:56.446821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:56.454590 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a690a4f5-ff06-4f7b-8c51-9b9ef2738f15 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:56.455032 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a690a4f5-ff06-4f7b-8c51-9b9ef2738f15 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:56.456102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a690a4f5-ff06-4f7b-8c51-9b9ef2738f15 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:56.456865 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a690a4f5-ff06-4f7b-8c51-9b9ef2738f15 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:56.457605 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:56.458707 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:56.460369 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:56.461419 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:56.635744 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a690a4f5-ff06-4f7b-8c51-9b9ef2738f15 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:56.653067 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a690a4f5-ff06-4f7b-8c51-9b9ef2738f15 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.225655 Jul 04 08:06:56.654889 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 194/403] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:56 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:56.664362 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7afbd24b-09c1-422e-835b-92df31f137bd tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:56.666047 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7afbd24b-09c1-422e-835b-92df31f137bd tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:56.684624 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7afbd24b-09c1-422e-835b-92df31f137bd tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:56.685367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7afbd24b-09c1-422e-835b-92df31f137bd tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:56.686934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7afbd24b-09c1-422e-835b-92df31f137bd tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:56.687648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7afbd24b-09c1-422e-835b-92df31f137bd tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:56.696045 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:56.728569 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:56.733928 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:56.740134 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1e58e247-73bf-45cc-9ddc-0bf9d52c7215 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.301356 Jul 04 08:06:56.751074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 210/404] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:56 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:56.804849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7afbd24b-09c1-422e-835b-92df31f137bd tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:56.816088 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7afbd24b-09c1-422e-835b-92df31f137bd tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1187 microversion: 2.1 time: 0.159439 Jul 04 08:06:56.816691 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 195/405] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:56 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1187 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:57.675129 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-797c5ec7-9e69-4f7d-9b81-2ea29fd69c02 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:57.676177 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-797c5ec7-9e69-4f7d-9b81-2ea29fd69c02 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:57.684821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-797c5ec7-9e69-4f7d-9b81-2ea29fd69c02 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:57.685292 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-797c5ec7-9e69-4f7d-9b81-2ea29fd69c02 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:57.686136 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-797c5ec7-9e69-4f7d-9b81-2ea29fd69c02 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:57.686565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-797c5ec7-9e69-4f7d-9b81-2ea29fd69c02 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:57.766053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:57.772797 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:57.793809 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:57.795052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=10 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:57.799121 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:57.800732 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:57.802188 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:57.802986 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:57.814708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:06:58.009669 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-797c5ec7-9e69-4f7d-9b81-2ea29fd69c02 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:58.030709 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-797c5ec7-9e69-4f7d-9b81-2ea29fd69c02 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.361238 Jul 04 08:06:58.045686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 211/406] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:57 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:58.045686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fbe42a48-78c7-4f68-80fe-cde914c1b74f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:58.045686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fbe42a48-78c7-4f68-80fe-cde914c1b74f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:58.051180 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fbe42a48-78c7-4f68-80fe-cde914c1b74f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:58.051784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fbe42a48-78c7-4f68-80fe-cde914c1b74f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:58.052717 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fbe42a48-78c7-4f68-80fe-cde914c1b74f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:58.053265 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fbe42a48-78c7-4f68-80fe-cde914c1b74f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:58.114648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:58.125039 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:58.126958 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:58.129326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3a030710-1518-4114-9a6b-3911f7cb2063 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.370098 Jul 04 08:06:58.130554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 196/407] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:57 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:06:58.186549 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fbe42a48-78c7-4f68-80fe-cde914c1b74f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:58.201312 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fbe42a48-78c7-4f68-80fe-cde914c1b74f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1187 microversion: 2.1 time: 0.162016 Jul 04 08:06:58.202435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 212/408] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:58 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1187 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:59.059777 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ac4e300e-5f30-4194-a662-e204abbcb8a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:59.060698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ac4e300e-5f30-4194-a662-e204abbcb8a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:59.069474 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac4e300e-5f30-4194-a662-e204abbcb8a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:59.070131 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac4e300e-5f30-4194-a662-e204abbcb8a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:59.071065 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac4e300e-5f30-4194-a662-e204abbcb8a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:59.071651 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac4e300e-5f30-4194-a662-e204abbcb8a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:59.164325 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:59.165263 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:59.173149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:59.173841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:59.175195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:59.175825 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:59.232575 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ac4e300e-5f30-4194-a662-e204abbcb8a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:59.241357 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ac4e300e-5f30-4194-a662-e204abbcb8a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.186073 Jul 04 08:06:59.243246 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 197/409] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:59 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:59.246972 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-519790be-2767-4d9a-ae54-9fb5fa23c169 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:06:59.247698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-519790be-2767-4d9a-ae54-9fb5fa23c169 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:06:59.261869 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-519790be-2767-4d9a-ae54-9fb5fa23c169 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:59.262319 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-519790be-2767-4d9a-ae54-9fb5fa23c169 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:59.263101 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-519790be-2767-4d9a-ae54-9fb5fa23c169 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:06:59.263528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-519790be-2767-4d9a-ae54-9fb5fa23c169 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:06:59.349101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:59.350442 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-519790be-2767-4d9a-ae54-9fb5fa23c169 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:59.359684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:59.361356 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:06:59.362861 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fa8fbc80-13bb-47ae-81be-226aded26b4a tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.204227 Jul 04 08:06:59.363563 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 213/410] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:06:59 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:06:59.364528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-519790be-2767-4d9a-ae54-9fb5fa23c169 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1195 microversion: 2.1 time: 0.121162 Jul 04 08:06:59.365315 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 198/411] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:06:59 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1195 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:06:59.647079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1890405085", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "networks": [{"uuid": "498c549c-204b-4850-b62b-6e548456f096"}]}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:06:59.717426 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] validate_networks() for [('498c549c-204b-4850-b62b-6e548456f096', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:07:00.271286 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-588f47f9-4233-42ae-b32c-2472d848f822 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:00.273378 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-588f47f9-4233-42ae-b32c-2472d848f822 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:00.289609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:07:00.291463 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:07:00.292600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:07:00.293594 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:07:00.294693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:07:00.304869 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-588f47f9-4233-42ae-b32c-2472d848f822 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:00.305720 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-588f47f9-4233-42ae-b32c-2472d848f822 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:00.307116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-588f47f9-4233-42ae-b32c-2472d848f822 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:00.308119 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-588f47f9-4233-42ae-b32c-2472d848f822 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:00.318309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:00.319084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:00.320583 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:00.321355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:00.360415 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Getting quotas for project 6de1b2d9c55f4af7b6793ac472a6d408. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:07:00.369357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Getting quotas for user 34b2b4070d344d7ca07a99985678467a and project 6de1b2d9c55f4af7b6793ac472a6d408. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:07:00.392447 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:07:00.397347 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:07:00.480057 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a0ced520-bcb8-46a4-89ef-0c65d43c9e80 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837724 Jul 04 08:07:00.487666 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 214/412] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:06:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:07:00.493478 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:00.495038 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:00.504587 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:00.505297 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:00.506291 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:00.508006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:00.670076 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-588f47f9-4233-42ae-b32c-2472d848f822 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:00.686355 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-588f47f9-4233-42ae-b32c-2472d848f822 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.423192 Jul 04 08:07:00.687430 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 199/413] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:00 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:00.701926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d2d65819-def3-4e68-825f-d3a4a24985ed tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:00.702538 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d2d65819-def3-4e68-825f-d3a4a24985ed tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:00.711982 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2d65819-def3-4e68-825f-d3a4a24985ed tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:00.718534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2d65819-def3-4e68-825f-d3a4a24985ed tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:00.722835 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2d65819-def3-4e68-825f-d3a4a24985ed tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:00.723917 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2d65819-def3-4e68-825f-d3a4a24985ed tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:01.130076 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:01.140961 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:01.143379 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:01.146953 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1bd668cb-5f60-4a6b-90f3-79baa9be9198 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.661507 Jul 04 08:07:01.147894 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 215/414] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:00 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:01.153139 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9beb1849-32b3-475e-a207-8ebfb9b50810 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:01.154355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9beb1849-32b3-475e-a207-8ebfb9b50810 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:01.166812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:01.182163 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d2d65819-def3-4e68-825f-d3a4a24985ed tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:01.191738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d2d65819-def3-4e68-825f-d3a4a24985ed tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1273 microversion: 2.1 time: 0.503046 Jul 04 08:07:01.195726 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 200/415] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:00 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1273 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:01.234145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9beb1849-32b3-475e-a207-8ebfb9b50810 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:01.243959 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9beb1849-32b3-475e-a207-8ebfb9b50810 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1219 microversion: 2.1 time: 0.094743 Jul 04 08:07:01.245314 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 216/416] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:01 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:01.711912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ea4851c5-0227-4b01-bf3e-ab3b112cba7f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:01.712484 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ea4851c5-0227-4b01-bf3e-ab3b112cba7f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:01.723061 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea4851c5-0227-4b01-bf3e-ab3b112cba7f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:01.723911 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea4851c5-0227-4b01-bf3e-ab3b112cba7f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:01.724975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea4851c5-0227-4b01-bf3e-ab3b112cba7f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:01.726009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ea4851c5-0227-4b01-bf3e-ab3b112cba7f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:02.066593 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ea4851c5-0227-4b01-bf3e-ab3b112cba7f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:02.075160 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ea4851c5-0227-4b01-bf3e-ab3b112cba7f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.367409 Jul 04 08:07:02.075745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 201/417] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:01 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:02.169027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:02.170086 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:02.182382 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:02.182792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:02.184188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:02.184928 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:02.223358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ebbdec53-5e80-498b-80a9-e07b7cda8403 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:02.225075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ebbdec53-5e80-498b-80a9-e07b7cda8403 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:02.239511 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ebbdec53-5e80-498b-80a9-e07b7cda8403 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:02.240568 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ebbdec53-5e80-498b-80a9-e07b7cda8403 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:02.242102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ebbdec53-5e80-498b-80a9-e07b7cda8403 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:02.243124 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ebbdec53-5e80-498b-80a9-e07b7cda8403 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:02.493280 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:02.510938 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:02.514681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:02.517720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3d791da2-4892-41a3-8573-e132c85f34b0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.353765 Jul 04 08:07:02.519756 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 217/418] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:02 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:02.528444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-93c427af-8e98-4508-be8d-c5c91636184e req-c4c1061a-7361-41ec-9378-5c1f9df11af3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bf7886-bd99-4926-bb03-78d6488963f8", "tag": "7b293845-76c3-49eb-ad43-17b180aeee72"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:02.545659 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-93c427af-8e98-4508-be8d-c5c91636184e req-c4c1061a-7361-41ec-9378-5c1f9df11af3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:02.547052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-93c427af-8e98-4508-be8d-c5c91636184e req-c4c1061a-7361-41ec-9378-5c1f9df11af3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:02.571379 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-93c427af-8e98-4508-be8d-c5c91636184e req-c4c1061a-7361-41ec-9378-5c1f9df11af3 service nova] Creating event network-changed:7b293845-76c3-49eb-ad43-17b180aeee72 for instance 52bf7886-bd99-4926-bb03-78d6488963f8 on hv-cinder-79760 Jul 04 08:07:02.579710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-93c427af-8e98-4508-be8d-c5c91636184e req-c4c1061a-7361-41ec-9378-5c1f9df11af3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058246 Jul 04 08:07:02.580613 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 218/419] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:02.587501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-85e7e5ed-2a0c-44e0-8223-98b518e6304c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:02.588263 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-85e7e5ed-2a0c-44e0-8223-98b518e6304c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:02.597978 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85e7e5ed-2a0c-44e0-8223-98b518e6304c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:02.598426 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85e7e5ed-2a0c-44e0-8223-98b518e6304c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:02.599475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85e7e5ed-2a0c-44e0-8223-98b518e6304c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:02.599913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85e7e5ed-2a0c-44e0-8223-98b518e6304c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:02.694802 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-85e7e5ed-2a0c-44e0-8223-98b518e6304c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:02.712354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-85e7e5ed-2a0c-44e0-8223-98b518e6304c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1289 microversion: 2.1 time: 0.129045 Jul 04 08:07:02.713568 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 219/420] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:02 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1289 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:02.746740 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ebbdec53-5e80-498b-80a9-e07b7cda8403 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:02.762505 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ebbdec53-5e80-498b-80a9-e07b7cda8403 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.548398 Jul 04 08:07:02.763200 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 202/421] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:02 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:02.917916 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 08:07:02.918199 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Mon Jul 4 08:07:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 08:07:03.114216 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-144809ad-4afc-4c88-8984-bde921ddc186 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:03.116081 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-144809ad-4afc-4c88-8984-bde921ddc186 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:03.134684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-144809ad-4afc-4c88-8984-bde921ddc186 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:03.135990 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-144809ad-4afc-4c88-8984-bde921ddc186 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:03.139090 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-144809ad-4afc-4c88-8984-bde921ddc186 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:03.140251 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-144809ad-4afc-4c88-8984-bde921ddc186 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:03.335092 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-144809ad-4afc-4c88-8984-bde921ddc186 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:03.353254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-144809ad-4afc-4c88-8984-bde921ddc186 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.248679 Jul 04 08:07:03.354334 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 220/422] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:03 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:03.538447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:03.539570 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:03.547395 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:03.547937 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:03.548801 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:03.549454 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:03.740353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d05f7725-f4cc-4577-816e-354246716e4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:03.741099 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d05f7725-f4cc-4577-816e-354246716e4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:03.749539 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d05f7725-f4cc-4577-816e-354246716e4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:03.750123 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d05f7725-f4cc-4577-816e-354246716e4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:03.750957 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d05f7725-f4cc-4577-816e-354246716e4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:03.751399 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d05f7725-f4cc-4577-816e-354246716e4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:03.913659 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d05f7725-f4cc-4577-816e-354246716e4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:03.923315 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d05f7725-f4cc-4577-816e-354246716e4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.188157 Jul 04 08:07:03.923893 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 221/423] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:03 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:03.929529 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-05551511-f9c2-468a-9036-9c9e52af04c0 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:03.930853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-05551511-f9c2-468a-9036-9c9e52af04c0 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:03.938086 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05551511-f9c2-468a-9036-9c9e52af04c0 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:03.938522 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05551511-f9c2-468a-9036-9c9e52af04c0 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:03.939300 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05551511-f9c2-468a-9036-9c9e52af04c0 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:03.939718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05551511-f9c2-468a-9036-9c9e52af04c0 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:04.064706 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:04.081610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:04.083896 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:04.085993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bd2949a4-8596-430d-9218-b01c93fbd1fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.552769 Jul 04 08:07:04.086747 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 203/424] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:03 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:04.130254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-05551511-f9c2-468a-9036-9c9e52af04c0 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:04.138198 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-05551511-f9c2-468a-9036-9c9e52af04c0 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.213022 Jul 04 08:07:04.138777 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 222/425] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:03 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:04.376388 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d2b11614-97b4-4023-a627-9cca6fa9b1e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:04.377574 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d2b11614-97b4-4023-a627-9cca6fa9b1e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:04.395426 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2b11614-97b4-4023-a627-9cca6fa9b1e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:04.396206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2b11614-97b4-4023-a627-9cca6fa9b1e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:04.397463 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2b11614-97b4-4023-a627-9cca6fa9b1e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:04.398287 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2b11614-97b4-4023-a627-9cca6fa9b1e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:04.670402 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d2b11614-97b4-4023-a627-9cca6fa9b1e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:04.680544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d2b11614-97b4-4023-a627-9cca6fa9b1e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.311459 Jul 04 08:07:04.681535 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 204/426] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:04 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:04.948000 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-97ed72be-4ac6-43cd-a1f6-3697e3d2f183 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:04.948740 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-97ed72be-4ac6-43cd-a1f6-3697e3d2f183 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:04.955630 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97ed72be-4ac6-43cd-a1f6-3697e3d2f183 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:04.956559 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97ed72be-4ac6-43cd-a1f6-3697e3d2f183 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:04.957531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97ed72be-4ac6-43cd-a1f6-3697e3d2f183 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:04.957989 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97ed72be-4ac6-43cd-a1f6-3697e3d2f183 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:05.026000 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-60f2895a-f7a1-41df-ae0d-3e250cbea08f req-6982d365-6c92-495a-8fd8-50d1808ef1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a747d37-45e9-43da-8a01-9be5126daadb", "tag": "ddeb972a-8e58-4c3c-8173-9a3c4a88ec2d"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:05.030508 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:05.038791 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-60f2895a-f7a1-41df-ae0d-3e250cbea08f req-6982d365-6c92-495a-8fd8-50d1808ef1e5 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:05.039674 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-60f2895a-f7a1-41df-ae0d-3e250cbea08f req-6982d365-6c92-495a-8fd8-50d1808ef1e5 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:05.054968 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-60f2895a-f7a1-41df-ae0d-3e250cbea08f req-6982d365-6c92-495a-8fd8-50d1808ef1e5 service nova] Creating event network-changed:ddeb972a-8e58-4c3c-8173-9a3c4a88ec2d for instance 1a747d37-45e9-43da-8a01-9be5126daadb on hv-cinder-79760 Jul 04 08:07:05.062464 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-60f2895a-f7a1-41df-ae0d-3e250cbea08f req-6982d365-6c92-495a-8fd8-50d1808ef1e5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039478 Jul 04 08:07:05.063967 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 205/427] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:07:05.108868 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:05.108868 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:05.121722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:05.122601 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:05.124334 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:05.125098 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:05.144234 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-97ed72be-4ac6-43cd-a1f6-3697e3d2f183 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:05.153750 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-97ed72be-4ac6-43cd-a1f6-3697e3d2f183 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.209611 Jul 04 08:07:05.154351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 223/428] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:04 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:05.159252 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e1ae59ab-4bf3-4308-9a63-e64a7a1b1729 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:05.159868 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e1ae59ab-4bf3-4308-9a63-e64a7a1b1729 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:05.170053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1ae59ab-4bf3-4308-9a63-e64a7a1b1729 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:05.170588 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1ae59ab-4bf3-4308-9a63-e64a7a1b1729 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:05.171607 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1ae59ab-4bf3-4308-9a63-e64a7a1b1729 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:05.172159 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1ae59ab-4bf3-4308-9a63-e64a7a1b1729 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:05.294312 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:05.307300 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:05.309202 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:05.310700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eb96673e-5d14-4391-bf2e-5c9ecdf503a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.209145 Jul 04 08:07:05.311513 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 206/429] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:05 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:05.337758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e1ae59ab-4bf3-4308-9a63-e64a7a1b1729 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:05.346176 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e1ae59ab-4bf3-4308-9a63-e64a7a1b1729 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.190686 Jul 04 08:07:05.347047 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 224/430] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:05 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:05.638841 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1430805810", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1698566224", "security_groups": [{"name": "tempest-secgroup-smoke-1279218911"}], "block_device_mapping_v2": [{"uuid": "11b6e2f3-74aa-47e8-81a4-b650af633521", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ae013d11-69a5-488a-bc48-9896b5be9f9a"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:05.707840 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-92daf654-1a11-4135-8a78-e97f5a855e2f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:05.708728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-92daf654-1a11-4135-8a78-e97f5a855e2f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:05.716908 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92daf654-1a11-4135-8a78-e97f5a855e2f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:05.717360 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92daf654-1a11-4135-8a78-e97f5a855e2f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:05.718203 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92daf654-1a11-4135-8a78-e97f5a855e2f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:05.718636 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92daf654-1a11-4135-8a78-e97f5a855e2f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:05.851376 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] validate_networks() for [('ae013d11-69a5-488a-bc48-9896b5be9f9a', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:07:05.887695 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-92daf654-1a11-4135-8a78-e97f5a855e2f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:05.896384 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-92daf654-1a11-4135-8a78-e97f5a855e2f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.194099 Jul 04 08:07:05.896987 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 225/431] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:05 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:06.174962 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-02c4450b-b0b4-4c03-9b6f-a14b72007bb4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:06.176030 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-02c4450b-b0b4-4c03-9b6f-a14b72007bb4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:06.186183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-02c4450b-b0b4-4c03-9b6f-a14b72007bb4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.186841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-02c4450b-b0b4-4c03-9b6f-a14b72007bb4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:06.188125 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-02c4450b-b0b4-4c03-9b6f-a14b72007bb4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.188861 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-02c4450b-b0b4-4c03-9b6f-a14b72007bb4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:06.292064 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:07:06.292599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:07:06.293055 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:07:06.293519 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:07:06.294028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:07:06.304790 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.305231 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:06.306265 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.306265 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:06.324980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Getting quotas for project d1b0f9c7bc044f6c802c8cd34da4eb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:07:06.329863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Getting quotas for user fa28f0e0b3b0488faf7db7bf7dc3854b and project d1b0f9c7bc044f6c802c8cd34da4eb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:07:06.344105 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-02c4450b-b0b4-4c03-9b6f-a14b72007bb4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:06.352386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-02c4450b-b0b4-4c03-9b6f-a14b72007bb4 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.183999 Jul 04 08:07:06.353174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 226/432] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:06 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:06.367282 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:06.367887 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:06.374347 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.374815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:06.375662 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.376118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:06.395700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:07:06.398909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11b6e2f3-74aa-47e8-81a4-b650af633521',volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:07:06.399587 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:06.568503 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b04c1836-81d6-439c-883b-b1acce8465bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.933293 Jul 04 08:07:06.577085 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 207/433] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:07:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 08:07:06.577388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:06.577548 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-642f2dbb-75ee-4dd8-8d9a-88c016178f4b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:06.577548 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-642f2dbb-75ee-4dd8-8d9a-88c016178f4b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:06.590710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:06.593937 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:06.596754 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2cbc6640-abe1-47f9-9579-a0cee41b19f0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.232523 Jul 04 08:07:06.599087 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 227/434] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:06 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:06.603508 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-642f2dbb-75ee-4dd8-8d9a-88c016178f4b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.604430 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-642f2dbb-75ee-4dd8-8d9a-88c016178f4b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:06.606479 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-642f2dbb-75ee-4dd8-8d9a-88c016178f4b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.607015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-642f2dbb-75ee-4dd8-8d9a-88c016178f4b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:06.609058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-057de089-19c4-4088-b36b-352ee5e152b7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:06.610753 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-057de089-19c4-4088-b36b-352ee5e152b7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:06.707281 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-057de089-19c4-4088-b36b-352ee5e152b7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:06.715630 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-057de089-19c4-4088-b36b-352ee5e152b7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1095 microversion: 2.1 time: 0.114666 Jul 04 08:07:06.719662 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 228/435] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:06 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1095 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:06.923195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-920a8d27-1a5d-42b1-9e27-40d67f920a88 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:06.924046 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-920a8d27-1a5d-42b1-9e27-40d67f920a88 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:06.932956 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-920a8d27-1a5d-42b1-9e27-40d67f920a88 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.933680 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-920a8d27-1a5d-42b1-9e27-40d67f920a88 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:06.934731 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-920a8d27-1a5d-42b1-9e27-40d67f920a88 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:06.935148 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-920a8d27-1a5d-42b1-9e27-40d67f920a88 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:07.135394 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-642f2dbb-75ee-4dd8-8d9a-88c016178f4b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:07.146786 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-920a8d27-1a5d-42b1-9e27-40d67f920a88 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:07.148077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-642f2dbb-75ee-4dd8-8d9a-88c016178f4b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.577373 Jul 04 08:07:07.148677 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 208/436] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:06 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:07.166811 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-920a8d27-1a5d-42b1-9e27-40d67f920a88 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.247751 Jul 04 08:07:07.168086 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 229/437] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:06 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:07.371054 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2d614ba4-482a-4972-84be-37a887359872 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:07.371646 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2d614ba4-482a-4972-84be-37a887359872 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:07.380613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d614ba4-482a-4972-84be-37a887359872 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:07.381061 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d614ba4-482a-4972-84be-37a887359872 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:07.381893 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d614ba4-482a-4972-84be-37a887359872 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:07.382329 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d614ba4-482a-4972-84be-37a887359872 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:07.631863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2d614ba4-482a-4972-84be-37a887359872 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:07.637092 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:07.637967 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:07.646602 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2d614ba4-482a-4972-84be-37a887359872 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.279601 Jul 04 08:07:07.647212 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 209/438] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:07 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:07.652291 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:07.653012 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:07.654516 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:07.655232 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:07.743990 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-dd32eb22-dd7b-4177-9f8c-52a8434be9c9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:07.745297 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-dd32eb22-dd7b-4177-9f8c-52a8434be9c9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:07.754769 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dd32eb22-dd7b-4177-9f8c-52a8434be9c9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:07.755499 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dd32eb22-dd7b-4177-9f8c-52a8434be9c9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:07.756769 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dd32eb22-dd7b-4177-9f8c-52a8434be9c9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:07.757473 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-dd32eb22-dd7b-4177-9f8c-52a8434be9c9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:07.817232 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:07.832742 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:07.833077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-dd32eb22-dd7b-4177-9f8c-52a8434be9c9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:07.835440 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:07.837044 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:07.837469 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7986e72a-74b7-41df-9b38-4e246c364001 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.211088 Jul 04 08:07:07.838471 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 230/439] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:07 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:07.849969 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-dd32eb22-dd7b-4177-9f8c-52a8434be9c9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1137 microversion: 2.1 time: 0.105509 Jul 04 08:07:07.849969 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 210/440] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:07 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1137 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:08.169298 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6acc8adc-a786-448d-8201-3ec56ccccb46 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:08.170863 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6acc8adc-a786-448d-8201-3ec56ccccb46 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:08.192212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6acc8adc-a786-448d-8201-3ec56ccccb46 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.193271 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6acc8adc-a786-448d-8201-3ec56ccccb46 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.194196 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bce2a7b8-45bc-411a-8840-3dff78b8634b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:08.196160 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6acc8adc-a786-448d-8201-3ec56ccccb46 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.196748 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bce2a7b8-45bc-411a-8840-3dff78b8634b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:08.197339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6acc8adc-a786-448d-8201-3ec56ccccb46 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.213894 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bce2a7b8-45bc-411a-8840-3dff78b8634b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.214907 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bce2a7b8-45bc-411a-8840-3dff78b8634b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.216851 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bce2a7b8-45bc-411a-8840-3dff78b8634b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.217773 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bce2a7b8-45bc-411a-8840-3dff78b8634b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.393565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6acc8adc-a786-448d-8201-3ec56ccccb46 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:08.402300 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6acc8adc-a786-448d-8201-3ec56ccccb46 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.240679 Jul 04 08:07:08.403189 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 231/441] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:08 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:08.458357 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bce2a7b8-45bc-411a-8840-3dff78b8634b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:08.469084 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bce2a7b8-45bc-411a-8840-3dff78b8634b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.285159 Jul 04 08:07:08.470586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 211/442] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:08 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:08.664101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-95dc5709-6d24-4176-af77-f3ef0f91ab87 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:08.665056 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-95dc5709-6d24-4176-af77-f3ef0f91ab87 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:08.673571 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-95dc5709-6d24-4176-af77-f3ef0f91ab87 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.674078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-95dc5709-6d24-4176-af77-f3ef0f91ab87 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.674852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-95dc5709-6d24-4176-af77-f3ef0f91ab87 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.675528 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-95dc5709-6d24-4176-af77-f3ef0f91ab87 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.834049 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-95dc5709-6d24-4176-af77-f3ef0f91ab87 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:08.842787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-95dc5709-6d24-4176-af77-f3ef0f91ab87 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.182755 Jul 04 08:07:08.843478 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 232/443] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:08 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:08.860710 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-25fad1f0-e1f2-4da7-9b34-09a235f98409 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:08.861324 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-25fad1f0-e1f2-4da7-9b34-09a235f98409 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:08.863514 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:08.864169 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:08.867966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25fad1f0-e1f2-4da7-9b34-09a235f98409 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.867966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25fad1f0-e1f2-4da7-9b34-09a235f98409 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.869294 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25fad1f0-e1f2-4da7-9b34-09a235f98409 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.869940 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25fad1f0-e1f2-4da7-9b34-09a235f98409 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.870543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.870994 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.871773 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:08.872200 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:08.941191 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-25fad1f0-e1f2-4da7-9b34-09a235f98409 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:08.951652 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-25fad1f0-e1f2-4da7-9b34-09a235f98409 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1193 microversion: 2.1 time: 0.094458 Jul 04 08:07:08.961527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 212/444] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:08 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1193 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:09.031655 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:09.041434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:09.043168 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:09.044629 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5a8f1a68-09ab-46c9-8699-ce32455f5a77 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.185759 Jul 04 08:07:09.044629 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 233/445] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:08 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:07:09.420020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c852d361-5ed8-4a0d-8eac-3bd97bc86c4a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:09.420528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c852d361-5ed8-4a0d-8eac-3bd97bc86c4a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:09.428833 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c852d361-5ed8-4a0d-8eac-3bd97bc86c4a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.429034 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c852d361-5ed8-4a0d-8eac-3bd97bc86c4a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.429848 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c852d361-5ed8-4a0d-8eac-3bd97bc86c4a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.430392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c852d361-5ed8-4a0d-8eac-3bd97bc86c4a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.490251 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5f2f9841-5243-45b1-b47e-7b7063e80cc3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:09.490866 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5f2f9841-5243-45b1-b47e-7b7063e80cc3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:09.498731 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5f2f9841-5243-45b1-b47e-7b7063e80cc3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.499175 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5f2f9841-5243-45b1-b47e-7b7063e80cc3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.499963 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5f2f9841-5243-45b1-b47e-7b7063e80cc3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.500394 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5f2f9841-5243-45b1-b47e-7b7063e80cc3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.606638 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c852d361-5ed8-4a0d-8eac-3bd97bc86c4a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:09.616613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c852d361-5ed8-4a0d-8eac-3bd97bc86c4a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.200477 Jul 04 08:07:09.626637 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 213/446] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:09 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:09.672920 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5f2f9841-5243-45b1-b47e-7b7063e80cc3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:09.681277 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5f2f9841-5243-45b1-b47e-7b7063e80cc3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1500 microversion: 2.1 time: 0.196118 Jul 04 08:07:09.681914 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 234/447] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:09 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1500 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:09.701368 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e16f4b4c-6121-4ba4-8c2f-a69ac1504872"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:09.702748 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:09.709554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.710044 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.710830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.711271 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.737664 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] HTTP exception thrown: Cannot 'attach_volume' instance 07d58cef-2712-485a-a46d-b96178458181 while it is in vm_state rescued Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Request method failure captured: Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: POST /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181/os-volume_attachments HTTP/1.1 Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 74 Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp86y5zB6tJmUvnCBxloMYPfz3Qu1J2vZNvALy11_SGklA0-6zpcp9i-qXZg_aKmNOY0KAVoTThFHL2J5xGD8lKRaA6HbDycVJoWay3Tx1aFQSmAK8oaRsWv5iQSyEwBVsMcnSHDiqUgbMRRPkeTzsn1MKqYqaic2Kn1UZ2Z_VEiH1s Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:07:09.739641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ecd5bc804a3b4f14b864fb4e0f8d1b98", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 9e3f73e469f34b66bfbe99c3d79ac129 Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {"volumeAttachment": {"volumeId": "e16f4b4c-6121-4ba4-8c2f-a69ac1504872"}} Jul 04 08:07:09.742468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Cannot 'attach_volume' instance 07d58cef-2712-485a-a46d-b96178458181 while it is in vm_state rescued Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'server_id': '07d58cef-2712-485a-a46d-b96178458181', 'body': {'volumeAttachment': {'volumeId': 'e16f4b4c-6121-4ba4-8c2f-a69ac1504872'}}} Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 07d58cef-2712-485a-a46d-b96178458181 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:07:09.744154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 07d58cef-2712-485a-a46d-b96178458181 while it is in vm_state rescued Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:09.746700 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:09.749365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:07:09.749365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:07:09.749365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 07d58cef-2712-485a-a46d-b96178458181 while it is in vm_state rescued Jul 04 08:07:09.749365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:09.749365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Returning 409 to user: Cannot 'attach_volume' instance 07d58cef-2712-485a-a46d-b96178458181 while it is in vm_state rescued {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:07:09.749365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-aee06619-9abc-4069-abdc-9d22f05a5ece tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044139 Jul 04 08:07:09.749365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 214/448] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:07:09 2022] POST /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 08:07:09.751734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-497f2225-5a4f-498b-80f0-f9d8d1d6f04a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:09.752650 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-497f2225-5a4f-498b-80f0-f9d8d1d6f04a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:09.759557 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-497f2225-5a4f-498b-80f0-f9d8d1d6f04a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.760005 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-497f2225-5a4f-498b-80f0-f9d8d1d6f04a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.760793 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-497f2225-5a4f-498b-80f0-f9d8d1d6f04a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.761220 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-497f2225-5a4f-498b-80f0-f9d8d1d6f04a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.842158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-497f2225-5a4f-498b-80f0-f9d8d1d6f04a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181/action" status: 202 len: 0 microversion: 2.1 time: 0.094049 Jul 04 08:07:09.842945 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 235/449] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:07:09 2022] POST /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:07:09.853148 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-abc8ecd7-b653-42b6-9712-5f885a4026d9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:09.854018 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-abc8ecd7-b653-42b6-9712-5f885a4026d9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:09.861729 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-abc8ecd7-b653-42b6-9712-5f885a4026d9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.862353 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-abc8ecd7-b653-42b6-9712-5f885a4026d9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.863123 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-abc8ecd7-b653-42b6-9712-5f885a4026d9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.863305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e1d1d402-d730-45a6-a47b-48f28c6d3bbe tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:09.863556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-abc8ecd7-b653-42b6-9712-5f885a4026d9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.864105 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e1d1d402-d730-45a6-a47b-48f28c6d3bbe tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:09.871690 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1d1d402-d730-45a6-a47b-48f28c6d3bbe tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.872434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1d1d402-d730-45a6-a47b-48f28c6d3bbe tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:09.873378 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1d1d402-d730-45a6-a47b-48f28c6d3bbe tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:09.873842 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1d1d402-d730-45a6-a47b-48f28c6d3bbe tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:10.007114 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-abc8ecd7-b653-42b6-9712-5f885a4026d9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:10.015206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-abc8ecd7-b653-42b6-9712-5f885a4026d9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1508 microversion: 2.1 time: 0.166117 Jul 04 08:07:10.015690 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 215/450] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:09 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:10.021054 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-92cca78f-85e5-4fc8-93c1-8758e4fcab99 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:10.021699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-92cca78f-85e5-4fc8-93c1-8758e4fcab99 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:10.028364 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-92cca78f-85e5-4fc8-93c1-8758e4fcab99 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:10.028814 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-92cca78f-85e5-4fc8-93c1-8758e4fcab99 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:10.029602 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-92cca78f-85e5-4fc8-93c1-8758e4fcab99 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:10.030071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-92cca78f-85e5-4fc8-93c1-8758e4fcab99 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:10.031242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e1d1d402-d730-45a6-a47b-48f28c6d3bbe tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:10.039691 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e1d1d402-d730-45a6-a47b-48f28c6d3bbe tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.181595 Jul 04 08:07:10.040291 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 236/451] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:09 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:10.067886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:10.068515 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:10.075395 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:10.075836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:10.076621 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:10.077053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:10.118021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-92cca78f-85e5-4fc8-93c1-8758e4fcab99 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:10.126611 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-92cca78f-85e5-4fc8-93c1-8758e4fcab99 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1201 microversion: 2.1 time: 0.109855 Jul 04 08:07:10.127543 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 216/452] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:10 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1201 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:10.227406 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:10.237353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:10.239039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:10.240247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a7724b05-3a46-410c-ac39-98f7b78221e2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.176938 Jul 04 08:07:10.240819 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 237/453] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:10 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:07:10.350006 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-c683d582-6e68-47e9-901e-3199128d4f90 req-7c9bbeb9-de52-4dfc-90b5-9687afb83893 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42c331b-8c2a-4f37-bd0a-7221b07bf3af", "name": "network-vif-plugged", "status": "completed", "tag": "624f3113-8fef-448f-b1f3-28db878c297b"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:10.358971 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c683d582-6e68-47e9-901e-3199128d4f90 req-7c9bbeb9-de52-4dfc-90b5-9687afb83893 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:10.359414 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c683d582-6e68-47e9-901e-3199128d4f90 req-7c9bbeb9-de52-4dfc-90b5-9687afb83893 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:10.372507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-c683d582-6e68-47e9-901e-3199128d4f90 req-7c9bbeb9-de52-4dfc-90b5-9687afb83893 service nova] Creating event network-vif-plugged:624f3113-8fef-448f-b1f3-28db878c297b for instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af on hv-cinder-79760 Jul 04 08:07:10.378588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-c683d582-6e68-47e9-901e-3199128d4f90 req-7c9bbeb9-de52-4dfc-90b5-9687afb83893 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032486 Jul 04 08:07:10.379223 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 217/454] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:10.635760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-757a2aa8-90ba-4aaa-b5e4-abfde138b06b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:10.636476 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-757a2aa8-90ba-4aaa-b5e4-abfde138b06b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:10.640341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:10.648730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-757a2aa8-90ba-4aaa-b5e4-abfde138b06b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:10.649223 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-757a2aa8-90ba-4aaa-b5e4-abfde138b06b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:10.650032 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-757a2aa8-90ba-4aaa-b5e4-abfde138b06b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:10.650461 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-757a2aa8-90ba-4aaa-b5e4-abfde138b06b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:10.791092 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-757a2aa8-90ba-4aaa-b5e4-abfde138b06b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:10.799217 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-757a2aa8-90ba-4aaa-b5e4-abfde138b06b tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.168174 Jul 04 08:07:10.799991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 238/455] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:10 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:11.035903 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1b1556f6-86e9-4627-b882-838b9899f89a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:11.036616 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1b1556f6-86e9-4627-b882-838b9899f89a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:11.043696 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b1556f6-86e9-4627-b882-838b9899f89a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.044074 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b1556f6-86e9-4627-b882-838b9899f89a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.044850 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b1556f6-86e9-4627-b882-838b9899f89a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.045323 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b1556f6-86e9-4627-b882-838b9899f89a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.056451 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6f3a7866-1725-428f-b243-4bae02322d4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:11.057330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6f3a7866-1725-428f-b243-4bae02322d4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:11.067369 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6f3a7866-1725-428f-b243-4bae02322d4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.067795 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6f3a7866-1725-428f-b243-4bae02322d4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.068583 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6f3a7866-1725-428f-b243-4bae02322d4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.069034 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6f3a7866-1725-428f-b243-4bae02322d4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.222441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6f3a7866-1725-428f-b243-4bae02322d4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:11.230385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6f3a7866-1725-428f-b243-4bae02322d4b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.177740 Jul 04 08:07:11.231091 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 239/456] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:11 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:11.244492 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fb330c65-cc61-4577-a432-fb6cd28877d5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:11.245112 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fb330c65-cc61-4577-a432-fb6cd28877d5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:11.251543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fb330c65-cc61-4577-a432-fb6cd28877d5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.251962 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fb330c65-cc61-4577-a432-fb6cd28877d5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.253394 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fb330c65-cc61-4577-a432-fb6cd28877d5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.254003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fb330c65-cc61-4577-a432-fb6cd28877d5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.287419 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1b1556f6-86e9-4627-b882-838b9899f89a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:11.295145 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1b1556f6-86e9-4627-b882-838b9899f89a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1508 microversion: 2.1 time: 0.264125 Jul 04 08:07:11.295650 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 218/457] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:11 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:11.300961 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:11.301856 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:11.308027 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.308466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.309217 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.309660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.319970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fb330c65-cc61-4577-a432-fb6cd28877d5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:11.328119 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fb330c65-cc61-4577-a432-fb6cd28877d5 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1211 microversion: 2.1 time: 0.095666 Jul 04 08:07:11.328757 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 240/458] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:11 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:11.449487 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:11.459159 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:11.460682 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:11.461906 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5b649ebd-7861-4d33-9c29-c1def2f19eee tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.165242 Jul 04 08:07:11.462481 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 219/459] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:11 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:11.818008 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f6fc6a43-4164-4332-b25d-faae48fd1734 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:11.818644 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f6fc6a43-4164-4332-b25d-faae48fd1734 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:11.825698 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f6fc6a43-4164-4332-b25d-faae48fd1734 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.826149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f6fc6a43-4164-4332-b25d-faae48fd1734 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.826917 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f6fc6a43-4164-4332-b25d-faae48fd1734 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:11.827347 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f6fc6a43-4164-4332-b25d-faae48fd1734 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:11.978807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f6fc6a43-4164-4332-b25d-faae48fd1734 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:11.987486 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f6fc6a43-4164-4332-b25d-faae48fd1734 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.174014 Jul 04 08:07:11.988066 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 241/460] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:11 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:12.248064 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e33e4dbf-d712-452c-9707-fe4e88ca642f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:12.248823 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e33e4dbf-d712-452c-9707-fe4e88ca642f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:12.256161 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e33e4dbf-d712-452c-9707-fe4e88ca642f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:12.256607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e33e4dbf-d712-452c-9707-fe4e88ca642f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:12.257363 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e33e4dbf-d712-452c-9707-fe4e88ca642f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:12.257826 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e33e4dbf-d712-452c-9707-fe4e88ca642f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:12.315272 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6b5638e2-4ea8-4b4a-8aa3-0c537987fa84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:12.316017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6b5638e2-4ea8-4b4a-8aa3-0c537987fa84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:12.322501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b5638e2-4ea8-4b4a-8aa3-0c537987fa84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:12.322947 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b5638e2-4ea8-4b4a-8aa3-0c537987fa84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:12.323720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b5638e2-4ea8-4b4a-8aa3-0c537987fa84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:12.324197 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b5638e2-4ea8-4b4a-8aa3-0c537987fa84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:12.458271 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e33e4dbf-d712-452c-9707-fe4e88ca642f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:12.472886 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e33e4dbf-d712-452c-9707-fe4e88ca642f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.227496 Jul 04 08:07:12.484356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 220/461] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:12 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:12.484356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7878a132-813c-41a8-8b03-69ade0f3570d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:12.484356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7878a132-813c-41a8-8b03-69ade0f3570d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:12.499474 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7878a132-813c-41a8-8b03-69ade0f3570d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:12.500003 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7878a132-813c-41a8-8b03-69ade0f3570d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:12.501299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7878a132-813c-41a8-8b03-69ade0f3570d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:12.502072 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7878a132-813c-41a8-8b03-69ade0f3570d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:12.530229 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6b5638e2-4ea8-4b4a-8aa3-0c537987fa84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:12.538445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6b5638e2-4ea8-4b4a-8aa3-0c537987fa84 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1508 microversion: 2.1 time: 0.227235 Jul 04 08:07:12.539315 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 242/462] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:12 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1508 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:12.543733 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:12.545402 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:12.553663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:12.554100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:12.554901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:12.555323 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:12.671355 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7878a132-813c-41a8-8b03-69ade0f3570d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:12.699385 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7878a132-813c-41a8-8b03-69ade0f3570d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1211 microversion: 2.1 time: 0.220854 Jul 04 08:07:12.702193 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 221/463] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:12 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1211 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:12.770712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:12.782108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:12.783794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:12.785293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2eb14287-14a8-4dbf-8867-1c73ab3aea7c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.245168 Jul 04 08:07:12.786266 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 243/464] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:12 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:13.009434 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0d7c6590-846a-4f1c-8b49-13d0e98e9946 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:13.010390 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0d7c6590-846a-4f1c-8b49-13d0e98e9946 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:13.022245 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0d7c6590-846a-4f1c-8b49-13d0e98e9946 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:13.024067 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0d7c6590-846a-4f1c-8b49-13d0e98e9946 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:13.025160 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0d7c6590-846a-4f1c-8b49-13d0e98e9946 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:13.027236 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0d7c6590-846a-4f1c-8b49-13d0e98e9946 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:13.490841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-67678d4e-f5d5-4836-b550-9c45f79e6bb8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:13.491489 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-67678d4e-f5d5-4836-b550-9c45f79e6bb8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:13.498399 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67678d4e-f5d5-4836-b550-9c45f79e6bb8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:13.498844 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67678d4e-f5d5-4836-b550-9c45f79e6bb8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:13.499612 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67678d4e-f5d5-4836-b550-9c45f79e6bb8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:13.500031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67678d4e-f5d5-4836-b550-9c45f79e6bb8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:13.504575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:13.571554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0d7c6590-846a-4f1c-8b49-13d0e98e9946 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:13.579768 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0d7c6590-846a-4f1c-8b49-13d0e98e9946 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.578216 Jul 04 08:07:13.581367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 222/465] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:12 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:13.586374 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-426492e8-f284-4a2a-9aa3-3a2fe0d88ade tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:13.587019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-426492e8-f284-4a2a-9aa3-3a2fe0d88ade tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:13.597466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-426492e8-f284-4a2a-9aa3-3a2fe0d88ade tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:13.598857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-426492e8-f284-4a2a-9aa3-3a2fe0d88ade tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:13.600143 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-426492e8-f284-4a2a-9aa3-3a2fe0d88ade tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:13.600910 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-426492e8-f284-4a2a-9aa3-3a2fe0d88ade tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:13.678949 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67678d4e-f5d5-4836-b550-9c45f79e6bb8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:13.690012 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-67678d4e-f5d5-4836-b550-9c45f79e6bb8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.202784 Jul 04 08:07:13.690784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 244/466] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:13 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:13.727774 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d01ad2b5-33db-4b43-b559-7a477c737d0e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:13.729040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d01ad2b5-33db-4b43-b559-7a477c737d0e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:13.743096 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d01ad2b5-33db-4b43-b559-7a477c737d0e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:13.743313 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d01ad2b5-33db-4b43-b559-7a477c737d0e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:13.744534 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d01ad2b5-33db-4b43-b559-7a477c737d0e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:13.745680 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d01ad2b5-33db-4b43-b559-7a477c737d0e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:13.940283 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-426492e8-f284-4a2a-9aa3-3a2fe0d88ade tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:13.958174 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-426492e8-f284-4a2a-9aa3-3a2fe0d88ade tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1508 microversion: 2.1 time: 0.375180 Jul 04 08:07:13.959550 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 223/467] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:13 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:13.970082 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d01ad2b5-33db-4b43-b559-7a477c737d0e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:13.980498 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:13.987089 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:13.999502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d01ad2b5-33db-4b43-b559-7a477c737d0e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1279 microversion: 2.1 time: 0.281605 Jul 04 08:07:14.001006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 245/468] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:13 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1279 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:14.010714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.011793 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.013390 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.014244 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.290226 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-330bb795-b5dd-400a-bcb4-fea9b021d9ff tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:14.291979 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-330bb795-b5dd-400a-bcb4-fea9b021d9ff tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:14.311884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-330bb795-b5dd-400a-bcb4-fea9b021d9ff tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.313499 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-330bb795-b5dd-400a-bcb4-fea9b021d9ff tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.315258 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-330bb795-b5dd-400a-bcb4-fea9b021d9ff tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.316069 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-330bb795-b5dd-400a-bcb4-fea9b021d9ff tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.390152 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-330bb795-b5dd-400a-bcb4-fea9b021d9ff tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545/ips" status: 200 len: 150 microversion: 2.1 time: 0.106715 Jul 04 08:07:14.404449 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 246/469] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:07:14 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545/ips => generated 150 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:07:14.415301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eda3d10e-ebd8-4764-8681-0e5675e3ccc6"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:14.416130 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:14.417338 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:14.428741 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.429511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.430911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.431675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.448499 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:14.453767 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:14.458626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b01f3b46-77cf-41a4-bdbf-344fd130efc9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.496749 Jul 04 08:07:14.462687 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 224/470] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:13 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:14.540588 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Invalid volume: volume eda3d10e-ebd8-4764-8681-0e5675e3ccc6 is already attached to instances: 3ce6703a-43b5-47a0-8d17-1794e718e3b1 Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: POST /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545/os-volume_attachments HTTP/1.1 Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 74 Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:07:14.542509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {"volumeAttachment": {"volumeId": "eda3d10e-ebd8-4764-8681-0e5675e3ccc6"}} Jul 04 08:07:14.544820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Invalid volume: volume eda3d10e-ebd8-4764-8681-0e5675e3ccc6 is already attached to instances: 3ce6703a-43b5-47a0-8d17-1794e718e3b1 Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'server_id': '4dfe5154-5465-4c6b-a6c0-d41f8fcfb545', 'body': {'volumeAttachment': {'volumeId': 'eda3d10e-ebd8-4764-8681-0e5675e3ccc6'}}} Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume eda3d10e-ebd8-4764-8681-0e5675e3ccc6 is already attached to instances: 3ce6703a-43b5-47a0-8d17-1794e718e3b1 Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:14.545899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume eda3d10e-ebd8-4764-8681-0e5675e3ccc6 is already attached to instances: 3ce6703a-43b5-47a0-8d17-1794e718e3b1 Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:14.547239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:14.548388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:14.548388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:07:14.548388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:07:14.548388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume eda3d10e-ebd8-4764-8681-0e5675e3ccc6 is already attached to instances: 3ce6703a-43b5-47a0-8d17-1794e718e3b1 Jul 04 08:07:14.548388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:14.548388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 400 to user: Invalid volume: volume eda3d10e-ebd8-4764-8681-0e5675e3ccc6 is already attached to instances: 3ce6703a-43b5-47a0-8d17-1794e718e3b1 {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:07:14.548388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ec0d29b6-a34b-4613-aad7-3d3d7e5668b8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.138463 Jul 04 08:07:14.548388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 247/471] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:07:14 2022] POST /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545/os-volume_attachments => generated 174 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:07:14.557070 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3110025e-8c92-4991-b18c-efcf64d2e50a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:14.557564 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3110025e-8c92-4991-b18c-efcf64d2e50a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:14.565378 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3110025e-8c92-4991-b18c-efcf64d2e50a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.565856 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3110025e-8c92-4991-b18c-efcf64d2e50a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.566673 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3110025e-8c92-4991-b18c-efcf64d2e50a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.567101 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3110025e-8c92-4991-b18c-efcf64d2e50a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.599799 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3110025e-8c92-4991-b18c-efcf64d2e50a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:07:14.604004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7a06ad69-595a-42c6-b6b5-f3179ea4e9f9 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:14.606164 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7a06ad69-595a-42c6-b6b5-f3179ea4e9f9 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:14.623386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7a06ad69-595a-42c6-b6b5-f3179ea4e9f9 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.624712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7a06ad69-595a-42c6-b6b5-f3179ea4e9f9 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.626587 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7a06ad69-595a-42c6-b6b5-f3179ea4e9f9 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.628224 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7a06ad69-595a-42c6-b6b5-f3179ea4e9f9 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.849982 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3110025e-8c92-4991-b18c-efcf64d2e50a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 204 len: 0 microversion: 2.1 time: 0.287438 Jul 04 08:07:14.852324 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 225/472] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:07:14 2022] DELETE /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 04 08:07:14.885253 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3e79f305-762a-400c-bd03-36e712885019 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:14.906715 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3e79f305-762a-400c-bd03-36e712885019 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:14.940942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3e79f305-762a-400c-bd03-36e712885019 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.946961 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3e79f305-762a-400c-bd03-36e712885019 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:14.948748 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3e79f305-762a-400c-bd03-36e712885019 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:14.949961 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3e79f305-762a-400c-bd03-36e712885019 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.115379 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7a06ad69-595a-42c6-b6b5-f3179ea4e9f9 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:15.142521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7a06ad69-595a-42c6-b6b5-f3179ea4e9f9 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.547580 Jul 04 08:07:15.146540 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 248/473] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:14 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:15.156964 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-835ec3dc-e83a-43bf-ae06-ad3440275ef9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:15.158631 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-835ec3dc-e83a-43bf-ae06-ad3440275ef9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:15.171315 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-835ec3dc-e83a-43bf-ae06-ad3440275ef9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.172510 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-835ec3dc-e83a-43bf-ae06-ad3440275ef9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.174508 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-835ec3dc-e83a-43bf-ae06-ad3440275ef9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.176050 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-835ec3dc-e83a-43bf-ae06-ad3440275ef9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.498430 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3e79f305-762a-400c-bd03-36e712885019 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:15.512427 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:15.517617 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3e79f305-762a-400c-bd03-36e712885019 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.662439 Jul 04 08:07:15.520297 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 226/474] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:14 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:15.532257 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-1b801ea2-f90d-4d3c-8460-8a2645d619e2 req-a743234d-1d97-42ad-ad05-317e49338ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bf7886-bd99-4926-bb03-78d6488963f8", "name": "network-vif-plugged", "status": "completed", "tag": "7b293845-76c3-49eb-ad43-17b180aeee72"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:15.555896 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1b801ea2-f90d-4d3c-8460-8a2645d619e2 req-a743234d-1d97-42ad-ad05-317e49338ab7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.556631 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1b801ea2-f90d-4d3c-8460-8a2645d619e2 req-a743234d-1d97-42ad-ad05-317e49338ab7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.568016 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-835ec3dc-e83a-43bf-ae06-ad3440275ef9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:15.598599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-835ec3dc-e83a-43bf-ae06-ad3440275ef9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1682 microversion: 2.1 time: 0.450075 Jul 04 08:07:15.600620 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 249/475] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:15 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1682 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:15.617178 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-1b801ea2-f90d-4d3c-8460-8a2645d619e2 req-a743234d-1d97-42ad-ad05-317e49338ab7 service nova] Creating event network-vif-plugged:7b293845-76c3-49eb-ad43-17b180aeee72 for instance 52bf7886-bd99-4926-bb03-78d6488963f8 on hv-cinder-79760 Jul 04 08:07:15.619730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9cba29d4-de87-4f47-ac35-fa6d1879097f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:15.620891 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9cba29d4-de87-4f47-ac35-fa6d1879097f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:15.623143 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-1b801ea2-f90d-4d3c-8460-8a2645d619e2 req-a743234d-1d97-42ad-ad05-317e49338ab7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101145 Jul 04 08:07:15.624056 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 227/476] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:15.631792 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8bd500fd-367e-4d4c-83dd-129423c229bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:15.633063 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8bd500fd-367e-4d4c-83dd-129423c229bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:15.641993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bd500fd-367e-4d4c-83dd-129423c229bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.643079 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bd500fd-367e-4d4c-83dd-129423c229bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.643888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cba29d4-de87-4f47-ac35-fa6d1879097f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.644422 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bd500fd-367e-4d4c-83dd-129423c229bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.644636 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cba29d4-de87-4f47-ac35-fa6d1879097f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.646546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8bd500fd-367e-4d4c-83dd-129423c229bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.646891 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cba29d4-de87-4f47-ac35-fa6d1879097f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.647758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cba29d4-de87-4f47-ac35-fa6d1879097f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.868207 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9cba29d4-de87-4f47-ac35-fa6d1879097f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:15.877058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9cba29d4-de87-4f47-ac35-fa6d1879097f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1508 microversion: 2.1 time: 0.274513 Jul 04 08:07:15.878269 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 250/477] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:15 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:15.886505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-7b516255-5fba-4384-b6d9-370d5acfea90 req-e4c565de-8cab-4175-b2b1-3d4b91f75076 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf097eb-a2e5-4ce3-b0d9-1104988fe661", "tag": "664da2ec-3174-44ad-9296-0f70c9630416"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:15.887211 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8bd500fd-367e-4d4c-83dd-129423c229bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:15.899726 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-7b516255-5fba-4384-b6d9-370d5acfea90 req-e4c565de-8cab-4175-b2b1-3d4b91f75076 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.900170 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-7b516255-5fba-4384-b6d9-370d5acfea90 req-e4c565de-8cab-4175-b2b1-3d4b91f75076 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.901788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8bd500fd-367e-4d4c-83dd-129423c229bf tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.275957 Jul 04 08:07:15.903151 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 228/478] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:15 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:15.912096 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:15.913685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:15.919596 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-7b516255-5fba-4384-b6d9-370d5acfea90 req-e4c565de-8cab-4175-b2b1-3d4b91f75076 service nova] Creating event network-changed:664da2ec-3174-44ad-9296-0f70c9630416 for instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 on hv-cinder-79760 Jul 04 08:07:15.925169 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-7b516255-5fba-4384-b6d9-370d5acfea90 req-e4c565de-8cab-4175-b2b1-3d4b91f75076 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045223 Jul 04 08:07:15.925855 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.925970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 251/479] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:15.927112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:15.929295 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:15.930233 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:16.109863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:16.125572 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:16.128966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:16.130670 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-80c89c2c-8a54-44cb-8250-c670390d6297 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1810 microversion: 2.20 time: 0.225883 Jul 04 08:07:16.131326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 229/480] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:15 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1810 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:16.166323 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d5e5098b-a170-4271-bb1a-7c8fc68a5bc2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:16.167179 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d5e5098b-a170-4271-bb1a-7c8fc68a5bc2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:16.174451 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5e5098b-a170-4271-bb1a-7c8fc68a5bc2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:16.175161 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5e5098b-a170-4271-bb1a-7c8fc68a5bc2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:16.176017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5e5098b-a170-4271-bb1a-7c8fc68a5bc2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:16.176452 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5e5098b-a170-4271-bb1a-7c8fc68a5bc2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:16.350206 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d5e5098b-a170-4271-bb1a-7c8fc68a5bc2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:16.365387 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d5e5098b-a170-4271-bb1a-7c8fc68a5bc2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.204421 Jul 04 08:07:16.366514 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 252/481] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:16 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:16.538409 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8e04e9d7-c652-49ba-b9c7-f794227d862d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:16.539203 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8e04e9d7-c652-49ba-b9c7-f794227d862d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:16.543679 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:16.544895 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:16.553008 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8e04e9d7-c652-49ba-b9c7-f794227d862d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:16.553486 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8e04e9d7-c652-49ba-b9c7-f794227d862d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:16.554345 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8e04e9d7-c652-49ba-b9c7-f794227d862d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:16.554786 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8e04e9d7-c652-49ba-b9c7-f794227d862d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:16.626714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-93cbd9d7-7873-4b4c-b2ed-dabbebd3d18b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:16.628142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-93cbd9d7-7873-4b4c-b2ed-dabbebd3d18b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:16.647030 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-93cbd9d7-7873-4b4c-b2ed-dabbebd3d18b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:16.647790 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-93cbd9d7-7873-4b4c-b2ed-dabbebd3d18b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:16.649262 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-93cbd9d7-7873-4b4c-b2ed-dabbebd3d18b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:16.650098 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-93cbd9d7-7873-4b4c-b2ed-dabbebd3d18b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:16.713367 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=10 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:16.777806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8e04e9d7-c652-49ba-b9c7-f794227d862d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:16.798493 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8e04e9d7-c652-49ba-b9c7-f794227d862d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.264568 Jul 04 08:07:16.814223 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 230/482] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:16 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:16.900095 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f897e43f-0eba-4a03-bf4c-caf963626b6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:16.900945 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f897e43f-0eba-4a03-bf4c-caf963626b6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:16.910968 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f897e43f-0eba-4a03-bf4c-caf963626b6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:16.911661 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f897e43f-0eba-4a03-bf4c-caf963626b6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:16.912655 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f897e43f-0eba-4a03-bf4c-caf963626b6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:16.913366 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f897e43f-0eba-4a03-bf4c-caf963626b6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:16.981485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-93cbd9d7-7873-4b4c-b2ed-dabbebd3d18b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:16.996138 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-93cbd9d7-7873-4b4c-b2ed-dabbebd3d18b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1682 microversion: 2.1 time: 0.376838 Jul 04 08:07:16.997663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 253/483] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:16 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1682 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:17.005289 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-126bb804-2845-4cd1-bf37-0280255178a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:17.006921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-126bb804-2845-4cd1-bf37-0280255178a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:17.019812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-126bb804-2845-4cd1-bf37-0280255178a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.020951 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-126bb804-2845-4cd1-bf37-0280255178a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.022671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-126bb804-2845-4cd1-bf37-0280255178a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.023695 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-126bb804-2845-4cd1-bf37-0280255178a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.160689 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f897e43f-0eba-4a03-bf4c-caf963626b6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:17.175450 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f897e43f-0eba-4a03-bf4c-caf963626b6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1508 microversion: 2.1 time: 0.282033 Jul 04 08:07:17.176716 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 231/484] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:16 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:17.187145 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a1827e17-bcb7-40af-8f57-a41db68bbc38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:17.188303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a1827e17-bcb7-40af-8f57-a41db68bbc38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:17.197086 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1827e17-bcb7-40af-8f57-a41db68bbc38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.197696 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1827e17-bcb7-40af-8f57-a41db68bbc38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.198607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1827e17-bcb7-40af-8f57-a41db68bbc38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.199173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1827e17-bcb7-40af-8f57-a41db68bbc38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.286943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-126bb804-2845-4cd1-bf37-0280255178a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:17.298298 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-126bb804-2845-4cd1-bf37-0280255178a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.298884 Jul 04 08:07:17.310031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 254/485] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:16 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:17.310031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:17.310031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:17.320414 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.321311 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.321999 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.322528 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.331587 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-a1827e17-bcb7-40af-8f57-a41db68bbc38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lazy-loading 'services' on Instance uuid 3b415c8c-45f0-4469-82d4-a3b8c3c6145f {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:07:17.447904 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a1827e17-bcb7-40af-8f57-a41db68bbc38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/os-volume_attachments/250c4d62-8b01-4a0c-8869-7d5e60c28437" status: 202 len: 0 microversion: 2.1 time: 0.268780 Jul 04 08:07:17.449108 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 232/486] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:07:17 2022] DELETE /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/os-volume_attachments/250c4d62-8b01-4a0c-8869-7d5e60c28437 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:07:17.464595 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ff5c0a8a-c7ca-413d-a4c2-883be2cd7cec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:17.465744 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ff5c0a8a-c7ca-413d-a4c2-883be2cd7cec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:17.477651 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff5c0a8a-c7ca-413d-a4c2-883be2cd7cec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.478802 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff5c0a8a-c7ca-413d-a4c2-883be2cd7cec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.480315 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff5c0a8a-c7ca-413d-a4c2-883be2cd7cec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.481075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff5c0a8a-c7ca-413d-a4c2-883be2cd7cec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.524678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:17.540089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:17.543351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:17.545346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-98306677-6103-45d6-a3f5-919392e14cdf tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1797 microversion: 2.20 time: 0.244537 Jul 04 08:07:17.546370 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 255/487] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:07:17 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1797 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:07:17.645855 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-1fd9176a-41b5-498e-9db7-c854688ebdc6 req-b6cecfc0-5ea6-40df-9234-873765941846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a747d37-45e9-43da-8a01-9be5126daadb", "name": "network-vif-plugged", "status": "completed", "tag": "ddeb972a-8e58-4c3c-8173-9a3c4a88ec2d"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:17.663393 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1fd9176a-41b5-498e-9db7-c854688ebdc6 req-b6cecfc0-5ea6-40df-9234-873765941846 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.664190 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1fd9176a-41b5-498e-9db7-c854688ebdc6 req-b6cecfc0-5ea6-40df-9234-873765941846 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.686200 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ff5c0a8a-c7ca-413d-a4c2-883be2cd7cec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:17.687074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-1fd9176a-41b5-498e-9db7-c854688ebdc6 req-b6cecfc0-5ea6-40df-9234-873765941846 service nova] Creating event network-vif-plugged:ddeb972a-8e58-4c3c-8173-9a3c4a88ec2d for instance 1a747d37-45e9-43da-8a01-9be5126daadb on hv-cinder-79760 Jul 04 08:07:17.696259 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-1fd9176a-41b5-498e-9db7-c854688ebdc6 req-b6cecfc0-5ea6-40df-9234-873765941846 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058205 Jul 04 08:07:17.696615 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ff5c0a8a-c7ca-413d-a4c2-883be2cd7cec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.245193 Jul 04 08:07:17.697268 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 233/488] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:17 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:17.697431 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 256/489] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:07:17.825467 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ca2c4bca-c53b-4ce0-bb31-ff944e5d537f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:17.826398 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ca2c4bca-c53b-4ce0-bb31-ff944e5d537f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:17.835110 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ca2c4bca-c53b-4ce0-bb31-ff944e5d537f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.835642 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ca2c4bca-c53b-4ce0-bb31-ff944e5d537f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:17.836592 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ca2c4bca-c53b-4ce0-bb31-ff944e5d537f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:17.837158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ca2c4bca-c53b-4ce0-bb31-ff944e5d537f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:18.027739 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ca2c4bca-c53b-4ce0-bb31-ff944e5d537f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:18.031548 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-605b895e-91f9-43b9-b1b7-131480428aac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:18.032588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-605b895e-91f9-43b9-b1b7-131480428aac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:18.037186 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ca2c4bca-c53b-4ce0-bb31-ff944e5d537f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.216357 Jul 04 08:07:18.037802 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 257/490] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:17 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:18.041977 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-605b895e-91f9-43b9-b1b7-131480428aac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:18.042540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-605b895e-91f9-43b9-b1b7-131480428aac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:18.043429 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-605b895e-91f9-43b9-b1b7-131480428aac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:18.043906 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-605b895e-91f9-43b9-b1b7-131480428aac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:18.195486 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6ef18025-11df-4756-a401-6b3aa133013e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:18.196687 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6ef18025-11df-4756-a401-6b3aa133013e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:18.205368 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ef18025-11df-4756-a401-6b3aa133013e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:18.206087 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ef18025-11df-4756-a401-6b3aa133013e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:18.207261 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ef18025-11df-4756-a401-6b3aa133013e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:18.207697 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ef18025-11df-4756-a401-6b3aa133013e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:18.222828 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-605b895e-91f9-43b9-b1b7-131480428aac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:18.237876 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-605b895e-91f9-43b9-b1b7-131480428aac tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1682 microversion: 2.1 time: 0.211184 Jul 04 08:07:18.239852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 234/491] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:18 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1682 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:18.324994 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a70f1465-81f0-4eb2-8e8c-d741275b87fe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:18.325673 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a70f1465-81f0-4eb2-8e8c-d741275b87fe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:18.333070 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a70f1465-81f0-4eb2-8e8c-d741275b87fe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:18.333606 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a70f1465-81f0-4eb2-8e8c-d741275b87fe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:18.334505 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a70f1465-81f0-4eb2-8e8c-d741275b87fe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:18.334937 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a70f1465-81f0-4eb2-8e8c-d741275b87fe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:18.385660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6ef18025-11df-4756-a401-6b3aa133013e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:18.394344 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6ef18025-11df-4756-a401-6b3aa133013e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1508 microversion: 2.1 time: 0.203825 Jul 04 08:07:18.394931 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 258/492] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:18 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1508 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:18.565851 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a70f1465-81f0-4eb2-8e8c-d741275b87fe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:18.582093 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a70f1465-81f0-4eb2-8e8c-d741275b87fe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.260578 Jul 04 08:07:18.583310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 235/493] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:18 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:18.722252 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f51ef53f-f914-4eae-b7e0-ea16dd04139e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:18.723537 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f51ef53f-f914-4eae-b7e0-ea16dd04139e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:18.735097 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f51ef53f-f914-4eae-b7e0-ea16dd04139e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:18.735997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f51ef53f-f914-4eae-b7e0-ea16dd04139e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:18.737585 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f51ef53f-f914-4eae-b7e0-ea16dd04139e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:18.738388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f51ef53f-f914-4eae-b7e0-ea16dd04139e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:18.933142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f51ef53f-f914-4eae-b7e0-ea16dd04139e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:18.947938 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f51ef53f-f914-4eae-b7e0-ea16dd04139e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.232546 Jul 04 08:07:18.949530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 259/494] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:18 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:19.065031 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-aa8c9f69-d62b-4da8-a4cd-ba872fc18963 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:19.066094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-aa8c9f69-d62b-4da8-a4cd-ba872fc18963 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:19.073505 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aa8c9f69-d62b-4da8-a4cd-ba872fc18963 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.074120 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aa8c9f69-d62b-4da8-a4cd-ba872fc18963 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:19.075056 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aa8c9f69-d62b-4da8-a4cd-ba872fc18963 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.075549 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-aa8c9f69-d62b-4da8-a4cd-ba872fc18963 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:19.258332 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-958dd5a9-dcdc-434b-a6a0-92b74d3b3f3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:19.259304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-958dd5a9-dcdc-434b-a6a0-92b74d3b3f3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:19.268326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-958dd5a9-dcdc-434b-a6a0-92b74d3b3f3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.269095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-958dd5a9-dcdc-434b-a6a0-92b74d3b3f3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:19.270121 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-958dd5a9-dcdc-434b-a6a0-92b74d3b3f3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.270790 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-958dd5a9-dcdc-434b-a6a0-92b74d3b3f3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:19.328549 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-aa8c9f69-d62b-4da8-a4cd-ba872fc18963 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:19.344705 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-aa8c9f69-d62b-4da8-a4cd-ba872fc18963 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.283648 Jul 04 08:07:19.362920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 236/495] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:19 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:19.424784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-116d09b1-09f4-4964-9909-4eb92822b241 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:19.426470 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-116d09b1-09f4-4964-9909-4eb92822b241 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:19.438195 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-116d09b1-09f4-4964-9909-4eb92822b241 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.439163 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-116d09b1-09f4-4964-9909-4eb92822b241 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:19.440686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-116d09b1-09f4-4964-9909-4eb92822b241 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.442443 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-116d09b1-09f4-4964-9909-4eb92822b241 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:19.501721 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-958dd5a9-dcdc-434b-a6a0-92b74d3b3f3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:19.511466 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-958dd5a9-dcdc-434b-a6a0-92b74d3b3f3a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1682 microversion: 2.1 time: 0.257365 Jul 04 08:07:19.512106 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 260/496] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:19 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1682 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:19.613315 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-599fa43b-13fb-40dd-9f73-9a54fdf71562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:19.614865 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-599fa43b-13fb-40dd-9f73-9a54fdf71562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:19.628438 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-599fa43b-13fb-40dd-9f73-9a54fdf71562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.629226 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-599fa43b-13fb-40dd-9f73-9a54fdf71562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:19.630114 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-599fa43b-13fb-40dd-9f73-9a54fdf71562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.630551 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-599fa43b-13fb-40dd-9f73-9a54fdf71562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:19.805940 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-116d09b1-09f4-4964-9909-4eb92822b241 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:19.814890 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-599fa43b-13fb-40dd-9f73-9a54fdf71562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:19.820875 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-116d09b1-09f4-4964-9909-4eb92822b241 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1514 microversion: 2.1 time: 0.403485 Jul 04 08:07:19.822017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 237/497] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:19 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:19.833758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-599fa43b-13fb-40dd-9f73-9a54fdf71562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.227949 Jul 04 08:07:19.835368 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 261/498] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:19 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:19.970104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3f610dc4-0322-459b-b835-7ca3835c39e4 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:19.970712 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3f610dc4-0322-459b-b835-7ca3835c39e4 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:19.980344 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f610dc4-0322-459b-b835-7ca3835c39e4 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.980966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f610dc4-0322-459b-b835-7ca3835c39e4 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:19.982050 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f610dc4-0322-459b-b835-7ca3835c39e4 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:19.982973 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f610dc4-0322-459b-b835-7ca3835c39e4 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:20.373204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-05f92d17-aa68-49c8-ae42-7dfd7cbe3c9c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:20.373916 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-05f92d17-aa68-49c8-ae42-7dfd7cbe3c9c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:20.384289 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05f92d17-aa68-49c8-ae42-7dfd7cbe3c9c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:20.385077 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05f92d17-aa68-49c8-ae42-7dfd7cbe3c9c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:20.386057 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05f92d17-aa68-49c8-ae42-7dfd7cbe3c9c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:20.386606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05f92d17-aa68-49c8-ae42-7dfd7cbe3c9c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:20.416016 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:20.453172 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3f610dc4-0322-459b-b835-7ca3835c39e4 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:20.463194 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3f610dc4-0322-459b-b835-7ca3835c39e4 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.498145 Jul 04 08:07:20.473383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 238/499] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:19 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:20.541032 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ca0273d5-bcdc-4ec2-8fde-6efdbd0a7c05 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:20.542798 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ca0273d5-bcdc-4ec2-8fde-6efdbd0a7c05 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:20.557536 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca0273d5-bcdc-4ec2-8fde-6efdbd0a7c05 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:20.558751 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca0273d5-bcdc-4ec2-8fde-6efdbd0a7c05 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:20.560081 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca0273d5-bcdc-4ec2-8fde-6efdbd0a7c05 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:20.561148 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ca0273d5-bcdc-4ec2-8fde-6efdbd0a7c05 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:20.612860 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-05f92d17-aa68-49c8-ae42-7dfd7cbe3c9c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:20.624421 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-05f92d17-aa68-49c8-ae42-7dfd7cbe3c9c tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.257272 Jul 04 08:07:20.626023 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 262/500] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:20 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:20.715558 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ca0273d5-bcdc-4ec2-8fde-6efdbd0a7c05 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:20.727521 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ca0273d5-bcdc-4ec2-8fde-6efdbd0a7c05 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1614 microversion: 2.1 time: 0.197282 Jul 04 08:07:20.742776 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 239/501] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:20 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1614 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:20.837667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5b8d655f-5733-48a5-a754-cc58530a5913 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:20.852770 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5b8d655f-5733-48a5-a754-cc58530a5913 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:20.855614 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5b8d655f-5733-48a5-a754-cc58530a5913 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:20.856076 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-76526c3b-a47f-4c82-a52f-8fcc4968dc2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:20.857033 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-76526c3b-a47f-4c82-a52f-8fcc4968dc2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:20.880460 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-76526c3b-a47f-4c82-a52f-8fcc4968dc2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:20.880666 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-76526c3b-a47f-4c82-a52f-8fcc4968dc2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:20.886846 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-76526c3b-a47f-4c82-a52f-8fcc4968dc2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:20.888373 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-76526c3b-a47f-4c82-a52f-8fcc4968dc2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:20.897005 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5b8d655f-5733-48a5-a754-cc58530a5913 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Going to try to stop instance {{(pid=117871) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 04 08:07:21.009882 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5b8d655f-5733-48a5-a754-cc58530a5913 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/action" status: 202 len: 0 microversion: 2.1 time: 0.177855 Jul 04 08:07:21.020669 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 263/502] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:07:20 2022] POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:07:21.038579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-91a5bca2-253c-41ec-a104-7922d32aca53 req-c3ebe2f0-3091-4784-abd5-253017e6371c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfe5154-5465-4c6b-a6c0-d41f8fcfb545", "name": "network-vif-deleted", "tag": "151eb673-5017-4a41-910b-b1a450507544"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:21.061077 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-91a5bca2-253c-41ec-a104-7922d32aca53 req-c3ebe2f0-3091-4784-abd5-253017e6371c service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:21.063179 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-91a5bca2-253c-41ec-a104-7922d32aca53 req-c3ebe2f0-3091-4784-abd5-253017e6371c service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:21.089561 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-91a5bca2-253c-41ec-a104-7922d32aca53 req-c3ebe2f0-3091-4784-abd5-253017e6371c service nova] Creating event network-vif-deleted:151eb673-5017-4a41-910b-b1a450507544 for instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 on hv-cinder-79760 Jul 04 08:07:21.100074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-91a5bca2-253c-41ec-a104-7922d32aca53 req-c3ebe2f0-3091-4784-abd5-253017e6371c service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074983 Jul 04 08:07:21.101767 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 264/503] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:21.116028 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2c2af3d0-03e3-4e7d-a56a-690fe625ecb8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:21.118262 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2c2af3d0-03e3-4e7d-a56a-690fe625ecb8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:21.130189 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:21.134346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c2af3d0-03e3-4e7d-a56a-690fe625ecb8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:21.135023 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c2af3d0-03e3-4e7d-a56a-690fe625ecb8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:21.136432 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c2af3d0-03e3-4e7d-a56a-690fe625ecb8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:21.137383 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c2af3d0-03e3-4e7d-a56a-690fe625ecb8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:21.167148 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-76526c3b-a47f-4c82-a52f-8fcc4968dc2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:21.181695 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-76526c3b-a47f-4c82-a52f-8fcc4968dc2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.332208 Jul 04 08:07:21.182301 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 240/504] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:20 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:21.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2c2af3d0-03e3-4e7d-a56a-690fe625ecb8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:21.463573 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7fdaf453-9b7b-4649-a877-e77ce5a3424a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'create', calling method: .version_select at 0x7f05e56e1f70>, body: {"keypair": {"name": "tempest-keypair-1632504715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXaKaKthV55ylOjRBZbxy5FJ6GsyFgZMm1qY5rWxVHfI/i1NeYo9FC8yqwTWxIAr59h2p7BKZbwWtiXvQGSi3VEm+fDt19Vx+9DgyhDfs36yrn4Vo7S+jogprfndguISA=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:21.481918 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2c2af3d0-03e3-4e7d-a56a-690fe625ecb8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1677 microversion: 2.1 time: 0.377405 Jul 04 08:07:21.496977 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 265/505] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:21 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1677 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:21.503917 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-7fdaf453-9b7b-4649-a877-e77ce5a3424a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Getting quotas for project ecd5bc804a3b4f14b864fb4e0f8d1b98. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:07:21.512752 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-7fdaf453-9b7b-4649-a877-e77ce5a3424a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Getting quotas for user 9e3f73e469f34b66bfbe99c3d79ac129 and project ecd5bc804a3b4f14b864fb4e0f8d1b98. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:07:21.516423 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b2878738-a4f7-437e-934a-5ba778975999 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:21.517685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:21.518478 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b2878738-a4f7-437e-934a-5ba778975999 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:21.531858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2878738-a4f7-437e-934a-5ba778975999 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:21.533252 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2878738-a4f7-437e-934a-5ba778975999 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:21.535135 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2878738-a4f7-437e-934a-5ba778975999 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:21.536141 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2878738-a4f7-437e-934a-5ba778975999 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:21.557212 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7fdaf453-9b7b-4649-a877-e77ce5a3424a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101609 Jul 04 08:07:21.558253 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 241/506] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:07:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:07:21.652061 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-10c948b7-f708-42bf-afa5-881e6d53ade1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:21.653600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-10c948b7-f708-42bf-afa5-881e6d53ade1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:21.674934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-10c948b7-f708-42bf-afa5-881e6d53ade1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:21.677253 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-10c948b7-f708-42bf-afa5-881e6d53ade1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:21.682658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-10c948b7-f708-42bf-afa5-881e6d53ade1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:21.684519 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-10c948b7-f708-42bf-afa5-881e6d53ade1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:21.748036 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b2878738-a4f7-437e-934a-5ba778975999 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:21.780048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b2878738-a4f7-437e-934a-5ba778975999 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1261 microversion: 2.1 time: 0.280595 Jul 04 08:07:21.793728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 266/507] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:21 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1261 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:21.793728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-34c285ca-c7ce-45da-89c5-a289e32c0c59 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:21.793728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-34c285ca-c7ce-45da-89c5-a289e32c0c59 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:21.800776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34c285ca-c7ce-45da-89c5-a289e32c0c59 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:21.800776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34c285ca-c7ce-45da-89c5-a289e32c0c59 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:21.800776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34c285ca-c7ce-45da-89c5-a289e32c0c59 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:21.800776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34c285ca-c7ce-45da-89c5-a289e32c0c59 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:21.888897 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-34c285ca-c7ce-45da-89c5-a289e32c0c59 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:21.901133 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-34c285ca-c7ce-45da-89c5-a289e32c0c59 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1326 microversion: 2.1 time: 0.117771 Jul 04 08:07:21.912096 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 267/508] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:21 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1326 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:22.052034 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-10c948b7-f708-42bf-afa5-881e6d53ade1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:22.061704 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-10c948b7-f708-42bf-afa5-881e6d53ade1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1319 microversion: 2.1 time: 0.420557 Jul 04 08:07:22.072796 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 242/509] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:21 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:22.202508 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fc08b486-c585-411b-b225-4730d10e8a4c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:22.203564 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fc08b486-c585-411b-b225-4730d10e8a4c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:22.212341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fc08b486-c585-411b-b225-4730d10e8a4c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:22.212932 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fc08b486-c585-411b-b225-4730d10e8a4c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:22.214301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fc08b486-c585-411b-b225-4730d10e8a4c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:22.214831 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fc08b486-c585-411b-b225-4730d10e8a4c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:22.517210 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ab34d700-766d-4cb0-9240-2361a115a8b4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:22.518116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ab34d700-766d-4cb0-9240-2361a115a8b4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:22.529547 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab34d700-766d-4cb0-9240-2361a115a8b4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:22.533774 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab34d700-766d-4cb0-9240-2361a115a8b4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:22.535070 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab34d700-766d-4cb0-9240-2361a115a8b4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:22.535871 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab34d700-766d-4cb0-9240-2361a115a8b4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:22.551521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fc08b486-c585-411b-b225-4730d10e8a4c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:22.567364 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fc08b486-c585-411b-b225-4730d10e8a4c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.369930 Jul 04 08:07:22.569532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 268/510] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:22 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:22.812904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b4f02c5b-eacc-4fe6-8cd9-b638313629a8 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:22.813739 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b4f02c5b-eacc-4fe6-8cd9-b638313629a8 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:22.822417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4f02c5b-eacc-4fe6-8cd9-b638313629a8 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:22.823023 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4f02c5b-eacc-4fe6-8cd9-b638313629a8 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:22.824016 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4f02c5b-eacc-4fe6-8cd9-b638313629a8 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:22.824721 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4f02c5b-eacc-4fe6-8cd9-b638313629a8 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.097463 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b4f02c5b-eacc-4fe6-8cd9-b638313629a8 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:23.113410 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b4f02c5b-eacc-4fe6-8cd9-b638313629a8 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1444 microversion: 2.1 time: 0.307445 Jul 04 08:07:23.120549 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 269/511] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:22 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1444 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:23.140779 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:23.142428 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:23.163228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.163990 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.165371 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.166911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.195393 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ab34d700-766d-4cb0-9240-2361a115a8b4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:23.208925 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ab34d700-766d-4cb0-9240-2361a115a8b4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1677 microversion: 2.1 time: 0.695714 Jul 04 08:07:23.210799 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 243/512] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:22 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1677 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:23.217744 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-db6a204e-d418-491c-87f4-c845aec0154f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:23.220354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-db6a204e-d418-491c-87f4-c845aec0154f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:23.229982 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db6a204e-d418-491c-87f4-c845aec0154f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.231549 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db6a204e-d418-491c-87f4-c845aec0154f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.234601 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db6a204e-d418-491c-87f4-c845aec0154f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.235563 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db6a204e-d418-491c-87f4-c845aec0154f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.276178 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:23.301212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.301985 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.302949 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lazy-loading 'fault' on Instance uuid 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:07:23.366370 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:23.375866 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-79117843-0cc0-45f9-ad4e-db383d914c02 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 200 len: 1331 microversion: 2.1 time: 0.253115 Jul 04 08:07:23.376581 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 270/513] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:23 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 1331 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:23.384805 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0a7fb977-aeff-4386-b150-9feee6f5dee7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:23.385794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0a7fb977-aeff-4386-b150-9feee6f5dee7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:23.394845 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a7fb977-aeff-4386-b150-9feee6f5dee7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.395596 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a7fb977-aeff-4386-b150-9feee6f5dee7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.396443 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a7fb977-aeff-4386-b150-9feee6f5dee7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.397051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a7fb977-aeff-4386-b150-9feee6f5dee7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.546388 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-db6a204e-d418-491c-87f4-c845aec0154f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:23.562807 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-db6a204e-d418-491c-87f4-c845aec0154f tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1508 microversion: 2.1 time: 0.349463 Jul 04 08:07:23.564141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 244/514] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:23 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1508 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:23.589953 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0936121a-04ab-4145-8366-63e1a3acbaf8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51ac8b92-4807-4cd7-8d17-f6199a815e51", "device": "/dev/sdb"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:23.592532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0936121a-04ab-4145-8366-63e1a3acbaf8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:23.602472 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0936121a-04ab-4145-8366-63e1a3acbaf8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.602973 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0936121a-04ab-4145-8366-63e1a3acbaf8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.604314 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0936121a-04ab-4145-8366-63e1a3acbaf8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.605113 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0936121a-04ab-4145-8366-63e1a3acbaf8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.626582 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0a7fb977-aeff-4386-b150-9feee6f5dee7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:23.640853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0a7fb977-aeff-4386-b150-9feee6f5dee7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1444 microversion: 2.1 time: 0.260962 Jul 04 08:07:23.649090 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 271/515] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:23 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1444 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:23.658158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d6fec7a9-1262-432e-9903-7223ad74b826 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:23.659522 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d6fec7a9-1262-432e-9903-7223ad74b826 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:23.670318 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d6fec7a9-1262-432e-9903-7223ad74b826 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.671927 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d6fec7a9-1262-432e-9903-7223ad74b826 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.673042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d6fec7a9-1262-432e-9903-7223ad74b826 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:23.674144 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d6fec7a9-1262-432e-9903-7223ad74b826 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:23.982158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d6fec7a9-1262-432e-9903-7223ad74b826 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:24.007251 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d6fec7a9-1262-432e-9903-7223ad74b826 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.355299 Jul 04 08:07:24.009656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 272/516] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:23 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:24.238322 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c3c73af6-8d63-4114-a361-6b04135963ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:24.240798 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c3c73af6-8d63-4114-a361-6b04135963ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:24.251724 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c3c73af6-8d63-4114-a361-6b04135963ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:24.252903 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c3c73af6-8d63-4114-a361-6b04135963ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:24.254950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c3c73af6-8d63-4114-a361-6b04135963ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:24.255405 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c3c73af6-8d63-4114-a361-6b04135963ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:24.605733 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c3c73af6-8d63-4114-a361-6b04135963ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:24.620859 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c3c73af6-8d63-4114-a361-6b04135963ad tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1677 microversion: 2.1 time: 0.387933 Jul 04 08:07:24.622782 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 273/517] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:24 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1677 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:24.632090 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:24.632651 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:24.643107 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:24.644443 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:24.645995 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:24.646718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:24.671740 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 HTTP/1.1 Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:07:24.676450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:07:24.678058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '4dfe5154-5465-4c6b-a6c0-d41f8fcfb545'} Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:07:24.678817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:07:24.680095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:07:24.681220 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:07:24.681220 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cd9dc4be-2ab0-488d-a729-ff3dbdda79b1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 404 len: 111 microversion: 2.1 time: 0.054592 Jul 04 08:07:24.681220 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 274/518] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:24 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:07:24.690496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1390986254", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c274a709-4c9c-4dc4-892d-1096227b79fc"}], "security_groups": [{"name": "tempest-securitygroup--383777046"}], "key_name": "tempest-keypair-1632504715", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:24.815137 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0936121a-04ab-4145-8366-63e1a3acbaf8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "POST /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.232484 Jul 04 08:07:24.816267 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 245/519] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:07:23 2022] POST /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb/os-volume_attachments => generated 194 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:07:24.821983 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-90d85331-8f76-4e6c-b560-661bd61f3fb1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '.version_select at 0x7f05e56dbe50>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:24.895412 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-90d85331-8f76-4e6c-b560-661bd61f3fb1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-567698803" status: 202 len: 0 microversion: 2.1 time: 0.077453 Jul 04 08:07:24.896661 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 246/520] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jul 4 08:07:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-567698803 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:07:24.929276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] validate_networks() for [('c274a709-4c9c-4dc4-892d-1096227b79fc', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:07:25.046667 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5fdac283-ff42-493f-9f77-b50d8af59f87 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:25.048103 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5fdac283-ff42-493f-9f77-b50d8af59f87 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:25.081593 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5fdac283-ff42-493f-9f77-b50d8af59f87 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:25.088249 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5fdac283-ff42-493f-9f77-b50d8af59f87 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:25.089515 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5fdac283-ff42-493f-9f77-b50d8af59f87 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:25.090239 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5fdac283-ff42-493f-9f77-b50d8af59f87 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:25.361072 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5fdac283-ff42-493f-9f77-b50d8af59f87 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:25.380937 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5fdac283-ff42-493f-9f77-b50d8af59f87 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.346409 Jul 04 08:07:25.382761 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 247/521] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:25 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:25.642019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-49b81489-9c10-45f3-bb40-7a9dbbf54aea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:25.643105 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-49b81489-9c10-45f3-bb40-7a9dbbf54aea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:25.651737 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-49b81489-9c10-45f3-bb40-7a9dbbf54aea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:25.652274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-49b81489-9c10-45f3-bb40-7a9dbbf54aea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:25.653301 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-49b81489-9c10-45f3-bb40-7a9dbbf54aea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:25.654113 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-49b81489-9c10-45f3-bb40-7a9dbbf54aea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:25.842680 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-49b81489-9c10-45f3-bb40-7a9dbbf54aea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:25.857085 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-49b81489-9c10-45f3-bb40-7a9dbbf54aea tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1677 microversion: 2.1 time: 0.218971 Jul 04 08:07:25.870040 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 248/522] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:25 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1677 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:26.403154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8fcdd439-a6c0-42a8-b359-9606f13764b9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:26.404210 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8fcdd439-a6c0-42a8-b359-9606f13764b9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:26.415441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8fcdd439-a6c0-42a8-b359-9606f13764b9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:26.416140 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8fcdd439-a6c0-42a8-b359-9606f13764b9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:26.417871 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8fcdd439-a6c0-42a8-b359-9606f13764b9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:26.418638 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8fcdd439-a6c0-42a8-b359-9606f13764b9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:26.453725 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:07:26.454276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:07:26.454850 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:07:26.455904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:07:26.456732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:07:26.470128 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:26.471355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:26.472903 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:26.473669 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:26.537331 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Getting quotas for project ecd5bc804a3b4f14b864fb4e0f8d1b98. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:07:26.545496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Getting quotas for user 9e3f73e469f34b66bfbe99c3d79ac129 and project ecd5bc804a3b4f14b864fb4e0f8d1b98. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:07:26.569682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:07:26.573975 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:07:26.642890 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8fcdd439-a6c0-42a8-b359-9606f13764b9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:26.661760 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8fcdd439-a6c0-42a8-b359-9606f13764b9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.265316 Jul 04 08:07:26.663185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 249/523] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:26 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:26.676709 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-068690a6-5731-4826-8538-6d80e75dcc62 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.994189 Jul 04 08:07:26.678500 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 275/524] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:07:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:07:26.693955 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0d645ae8-db6a-43c3-8098-f340afacb28f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:26.694971 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0d645ae8-db6a-43c3-8098-f340afacb28f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:26.788211 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0d645ae8-db6a-43c3-8098-f340afacb28f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:26.802407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0d645ae8-db6a-43c3-8098-f340afacb28f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1246 microversion: 2.1 time: 0.115483 Jul 04 08:07:26.803668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 250/525] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:26 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:26.884332 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ea6bb73d-19c5-477c-ae56-757d35da6cd1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:26.885505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ea6bb73d-19c5-477c-ae56-757d35da6cd1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:26.893841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ea6bb73d-19c5-477c-ae56-757d35da6cd1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:26.894711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ea6bb73d-19c5-477c-ae56-757d35da6cd1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:26.895481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ea6bb73d-19c5-477c-ae56-757d35da6cd1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:26.896395 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ea6bb73d-19c5-477c-ae56-757d35da6cd1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:26.939860 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1493f77d-81db-479b-8602-8277c1a9361f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:26.941913 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1493f77d-81db-479b-8602-8277c1a9361f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:26.957446 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1493f77d-81db-479b-8602-8277c1a9361f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:26.958296 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1493f77d-81db-479b-8602-8277c1a9361f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:26.960015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1493f77d-81db-479b-8602-8277c1a9361f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:26.960650 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1493f77d-81db-479b-8602-8277c1a9361f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:27.101294 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-1493f77d-81db-479b-8602-8277c1a9361f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lazy-loading 'services' on Instance uuid 3ce6703a-43b5-47a0-8d17-1794e718e3b1 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:07:27.198006 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1493f77d-81db-479b-8602-8277c1a9361f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments/eda3d10e-ebd8-4764-8681-0e5675e3ccc6" status: 202 len: 0 microversion: 2.1 time: 0.263183 Jul 04 08:07:27.198633 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 251/526] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:07:26 2022] DELETE /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments/eda3d10e-ebd8-4764-8681-0e5675e3ccc6 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 08:07:27.210149 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f2fb2d9f-3726-43ae-800d-07f703623428 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:27.212545 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f2fb2d9f-3726-43ae-800d-07f703623428 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:27.222256 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2fb2d9f-3726-43ae-800d-07f703623428 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:27.222739 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2fb2d9f-3726-43ae-800d-07f703623428 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:27.223804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2fb2d9f-3726-43ae-800d-07f703623428 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:27.224420 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2fb2d9f-3726-43ae-800d-07f703623428 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:27.273224 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f2fb2d9f-3726-43ae-800d-07f703623428 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068362 Jul 04 08:07:27.274443 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 252/527] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:27 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:27.274881 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ea6bb73d-19c5-477c-ae56-757d35da6cd1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:27.283920 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ea6bb73d-19c5-477c-ae56-757d35da6cd1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1677 microversion: 2.1 time: 0.405609 Jul 04 08:07:27.289671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 276/528] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:26 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1677 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:27.686099 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4ac822d1-a2a9-4dfb-9382-c962fb4691bc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:27.686741 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4ac822d1-a2a9-4dfb-9382-c962fb4691bc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:27.693809 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ac822d1-a2a9-4dfb-9382-c962fb4691bc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:27.694225 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ac822d1-a2a9-4dfb-9382-c962fb4691bc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:27.695355 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ac822d1-a2a9-4dfb-9382-c962fb4691bc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:27.695786 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ac822d1-a2a9-4dfb-9382-c962fb4691bc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:27.726291 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-16d7af28-81a5-45e2-8ce0-da0bcfe16702 req-8ff8aa14-0c2a-4872-817a-b0bd263fb270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bf7886-bd99-4926-bb03-78d6488963f8", "tag": "7b293845-76c3-49eb-ad43-17b180aeee72"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:27.736054 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-16d7af28-81a5-45e2-8ce0-da0bcfe16702 req-8ff8aa14-0c2a-4872-817a-b0bd263fb270 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:27.736649 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-16d7af28-81a5-45e2-8ce0-da0bcfe16702 req-8ff8aa14-0c2a-4872-817a-b0bd263fb270 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:27.750539 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-16d7af28-81a5-45e2-8ce0-da0bcfe16702 req-8ff8aa14-0c2a-4872-817a-b0bd263fb270 service nova] Creating event network-changed:7b293845-76c3-49eb-ad43-17b180aeee72 for instance 52bf7886-bd99-4926-bb03-78d6488963f8 on hv-cinder-79760 Jul 04 08:07:27.757040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-16d7af28-81a5-45e2-8ce0-da0bcfe16702 req-8ff8aa14-0c2a-4872-817a-b0bd263fb270 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034602 Jul 04 08:07:27.758074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 277/529] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:27.826305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-31f2861a-c878-40f5-97c7-f7dc1153d821 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:27.827034 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-31f2861a-c878-40f5-97c7-f7dc1153d821 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:27.834392 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31f2861a-c878-40f5-97c7-f7dc1153d821 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:27.834838 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31f2861a-c878-40f5-97c7-f7dc1153d821 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:27.836350 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31f2861a-c878-40f5-97c7-f7dc1153d821 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:27.836350 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31f2861a-c878-40f5-97c7-f7dc1153d821 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:27.860876 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4ac822d1-a2a9-4dfb-9382-c962fb4691bc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:27.869513 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4ac822d1-a2a9-4dfb-9382-c962fb4691bc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.188404 Jul 04 08:07:27.870125 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 253/530] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:27 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:27.905104 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-31f2861a-c878-40f5-97c7-f7dc1153d821 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:27.913616 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-31f2861a-c878-40f5-97c7-f7dc1153d821 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1298 microversion: 2.1 time: 0.091659 Jul 04 08:07:27.914218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 278/531] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:27 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1298 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:28.288564 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-60b60d30-34a6-4175-a19d-7422f8ce22cd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:28.289491 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-60b60d30-34a6-4175-a19d-7422f8ce22cd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:28.295905 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-60b60d30-34a6-4175-a19d-7422f8ce22cd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:28.296648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-60b60d30-34a6-4175-a19d-7422f8ce22cd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:28.297447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-60b60d30-34a6-4175-a19d-7422f8ce22cd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:28.298138 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-60b60d30-34a6-4175-a19d-7422f8ce22cd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:28.307916 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0187b504-08d6-4519-8d0c-d9b2716e0cc0 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:28.309111 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0187b504-08d6-4519-8d0c-d9b2716e0cc0 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:28.319702 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0187b504-08d6-4519-8d0c-d9b2716e0cc0 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:28.320234 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0187b504-08d6-4519-8d0c-d9b2716e0cc0 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:28.321062 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0187b504-08d6-4519-8d0c-d9b2716e0cc0 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:28.321489 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0187b504-08d6-4519-8d0c-d9b2716e0cc0 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:28.364873 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-60b60d30-34a6-4175-a19d-7422f8ce22cd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080691 Jul 04 08:07:28.365864 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 254/532] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:28 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:28.511874 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0187b504-08d6-4519-8d0c-d9b2716e0cc0 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:28.520775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0187b504-08d6-4519-8d0c-d9b2716e0cc0 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1677 microversion: 2.1 time: 0.217278 Jul 04 08:07:28.521382 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 279/533] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:28 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:28.888794 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e2fe9802-122d-4e9c-92a9-7eb6dfc3a3ce tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:28.891083 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e2fe9802-122d-4e9c-92a9-7eb6dfc3a3ce tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:28.898665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2fe9802-122d-4e9c-92a9-7eb6dfc3a3ce tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:28.899396 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2fe9802-122d-4e9c-92a9-7eb6dfc3a3ce tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:28.900340 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2fe9802-122d-4e9c-92a9-7eb6dfc3a3ce tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:28.901284 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2fe9802-122d-4e9c-92a9-7eb6dfc3a3ce tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:28.931609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-731eeeeb-75be-447f-b5ec-b73983ebde1d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:28.933304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-731eeeeb-75be-447f-b5ec-b73983ebde1d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:28.944737 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-731eeeeb-75be-447f-b5ec-b73983ebde1d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:28.945294 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-731eeeeb-75be-447f-b5ec-b73983ebde1d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:28.946195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-731eeeeb-75be-447f-b5ec-b73983ebde1d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:28.946687 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-731eeeeb-75be-447f-b5ec-b73983ebde1d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:28.967423 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:29.020321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-731eeeeb-75be-447f-b5ec-b73983ebde1d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:29.030162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-731eeeeb-75be-447f-b5ec-b73983ebde1d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1304 microversion: 2.1 time: 0.103172 Jul 04 08:07:29.041681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 280/534] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:28 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:29.334531 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e2fe9802-122d-4e9c-92a9-7eb6dfc3a3ce tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:29.350593 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e2fe9802-122d-4e9c-92a9-7eb6dfc3a3ce tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.467138 Jul 04 08:07:29.351620 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 255/535] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:28 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:29.383102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b3e89fa8-4864-42e7-9c91-e4b91d1b369b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:29.384959 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b3e89fa8-4864-42e7-9c91-e4b91d1b369b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:29.395329 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b3e89fa8-4864-42e7-9c91-e4b91d1b369b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:29.396037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b3e89fa8-4864-42e7-9c91-e4b91d1b369b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:29.397271 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b3e89fa8-4864-42e7-9c91-e4b91d1b369b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:29.398012 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b3e89fa8-4864-42e7-9c91-e4b91d1b369b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:29.440588 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b3e89fa8-4864-42e7-9c91-e4b91d1b369b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064763 Jul 04 08:07:29.442913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 281/536] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:29 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:29.538794 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b1161ec0-2e13-4fba-a16f-ec097bfeeb39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:29.539576 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b1161ec0-2e13-4fba-a16f-ec097bfeeb39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:29.546310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b1161ec0-2e13-4fba-a16f-ec097bfeeb39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:29.546967 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b1161ec0-2e13-4fba-a16f-ec097bfeeb39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:29.547825 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b1161ec0-2e13-4fba-a16f-ec097bfeeb39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:29.548260 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b1161ec0-2e13-4fba-a16f-ec097bfeeb39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:29.843124 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b1161ec0-2e13-4fba-a16f-ec097bfeeb39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:29.854745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b1161ec0-2e13-4fba-a16f-ec097bfeeb39 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1677 microversion: 2.1 time: 0.319736 Jul 04 08:07:29.855791 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 256/537] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:29 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1677 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:30.053261 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-098f3c25-28af-4b73-bd3a-417e5c594181 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:30.054550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-098f3c25-28af-4b73-bd3a-417e5c594181 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:30.063228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-098f3c25-28af-4b73-bd3a-417e5c594181 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:30.063840 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-098f3c25-28af-4b73-bd3a-417e5c594181 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:30.065373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-098f3c25-28af-4b73-bd3a-417e5c594181 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:30.065745 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-098f3c25-28af-4b73-bd3a-417e5c594181 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:30.230278 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-098f3c25-28af-4b73-bd3a-417e5c594181 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:30.238451 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-098f3c25-28af-4b73-bd3a-417e5c594181 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.192514 Jul 04 08:07:30.241688 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 282/538] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:30 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:30.372881 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1b7ee21e-6188-4497-b2f0-5931fbd771ab tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:30.373665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1b7ee21e-6188-4497-b2f0-5931fbd771ab tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:30.384157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b7ee21e-6188-4497-b2f0-5931fbd771ab tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:30.384604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b7ee21e-6188-4497-b2f0-5931fbd771ab tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:30.385375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b7ee21e-6188-4497-b2f0-5931fbd771ab tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:30.386000 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1b7ee21e-6188-4497-b2f0-5931fbd771ab tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:30.452873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9fa53bb4-c9f9-4fe5-a02b-3e5f040ca2eb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:30.453840 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9fa53bb4-c9f9-4fe5-a02b-3e5f040ca2eb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:30.461162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9fa53bb4-c9f9-4fe5-a02b-3e5f040ca2eb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:30.461652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9fa53bb4-c9f9-4fe5-a02b-3e5f040ca2eb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:30.462420 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9fa53bb4-c9f9-4fe5-a02b-3e5f040ca2eb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:30.462858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9fa53bb4-c9f9-4fe5-a02b-3e5f040ca2eb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:30.496658 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9fa53bb4-c9f9-4fe5-a02b-3e5f040ca2eb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047811 Jul 04 08:07:30.497223 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 283/539] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:30 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:30.633547 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1b7ee21e-6188-4497-b2f0-5931fbd771ab tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:30.642122 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1b7ee21e-6188-4497-b2f0-5931fbd771ab tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.273096 Jul 04 08:07:30.642951 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 257/540] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:30 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:30.873069 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-32444513-3ca4-47ac-9502-eb3d50d23667 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:30.873761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-32444513-3ca4-47ac-9502-eb3d50d23667 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:30.881726 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32444513-3ca4-47ac-9502-eb3d50d23667 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:30.882184 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32444513-3ca4-47ac-9502-eb3d50d23667 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:30.882955 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32444513-3ca4-47ac-9502-eb3d50d23667 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:30.883383 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32444513-3ca4-47ac-9502-eb3d50d23667 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:31.074877 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-32444513-3ca4-47ac-9502-eb3d50d23667 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:31.086626 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-32444513-3ca4-47ac-9502-eb3d50d23667 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1677 microversion: 2.1 time: 0.217240 Jul 04 08:07:31.097668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 284/541] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:30 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:31.104096 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-e088906d-e827-4882-be67-33c3c4b9f2b3 req-00c20158-c806-4cc2-b7d3-416717950784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab500b1-c48b-483c-978c-c34e45412a3a", "tag": "7cbefb7a-840f-4963-a04b-770627ab4955"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:31.117456 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-e088906d-e827-4882-be67-33c3c4b9f2b3 req-00c20158-c806-4cc2-b7d3-416717950784 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:31.118387 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-e088906d-e827-4882-be67-33c3c4b9f2b3 req-00c20158-c806-4cc2-b7d3-416717950784 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:31.132599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-e088906d-e827-4882-be67-33c3c4b9f2b3 req-00c20158-c806-4cc2-b7d3-416717950784 service nova] Creating event network-changed:7cbefb7a-840f-4963-a04b-770627ab4955 for instance 3ab500b1-c48b-483c-978c-c34e45412a3a on hv-cinder-79760 Jul 04 08:07:31.138199 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-e088906d-e827-4882-be67-33c3c4b9f2b3 req-00c20158-c806-4cc2-b7d3-416717950784 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038363 Jul 04 08:07:31.138987 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 258/542] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:31.257389 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-859ceeac-4968-489e-9605-2f17cfc79d31 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:31.258079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-859ceeac-4968-489e-9605-2f17cfc79d31 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:31.265258 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-859ceeac-4968-489e-9605-2f17cfc79d31 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:31.265824 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-859ceeac-4968-489e-9605-2f17cfc79d31 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:31.266677 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-859ceeac-4968-489e-9605-2f17cfc79d31 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:31.267177 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-859ceeac-4968-489e-9605-2f17cfc79d31 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:31.430201 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-859ceeac-4968-489e-9605-2f17cfc79d31 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:31.440632 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-859ceeac-4968-489e-9605-2f17cfc79d31 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.187796 Jul 04 08:07:31.441432 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 285/543] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:31 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:31.510989 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e2670336-38cb-4dcf-8d32-15d15abe6c27 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:31.512008 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e2670336-38cb-4dcf-8d32-15d15abe6c27 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:31.519101 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2670336-38cb-4dcf-8d32-15d15abe6c27 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:31.519535 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2670336-38cb-4dcf-8d32-15d15abe6c27 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:31.520294 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2670336-38cb-4dcf-8d32-15d15abe6c27 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:31.520714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e2670336-38cb-4dcf-8d32-15d15abe6c27 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:31.553521 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e2670336-38cb-4dcf-8d32-15d15abe6c27 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047680 Jul 04 08:07:31.554060 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 259/544] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:31 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:31.660809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-016a67d0-2ea8-44c7-8cef-e4390ebeeda0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:31.661421 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-016a67d0-2ea8-44c7-8cef-e4390ebeeda0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:31.672241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-016a67d0-2ea8-44c7-8cef-e4390ebeeda0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:31.672693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-016a67d0-2ea8-44c7-8cef-e4390ebeeda0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:31.673617 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-016a67d0-2ea8-44c7-8cef-e4390ebeeda0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:31.674171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-016a67d0-2ea8-44c7-8cef-e4390ebeeda0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:31.829652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-016a67d0-2ea8-44c7-8cef-e4390ebeeda0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:31.838345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-016a67d0-2ea8-44c7-8cef-e4390ebeeda0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.182455 Jul 04 08:07:31.838920 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 286/545] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:31 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:32.107357 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-479203c8-deae-44dd-aa32-37d6066cfe09 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:32.107857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-479203c8-deae-44dd-aa32-37d6066cfe09 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:32.115142 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-479203c8-deae-44dd-aa32-37d6066cfe09 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:32.115624 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-479203c8-deae-44dd-aa32-37d6066cfe09 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:32.116484 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-479203c8-deae-44dd-aa32-37d6066cfe09 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:32.116891 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-479203c8-deae-44dd-aa32-37d6066cfe09 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:32.264118 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-479203c8-deae-44dd-aa32-37d6066cfe09 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:32.273854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-479203c8-deae-44dd-aa32-37d6066cfe09 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1677 microversion: 2.1 time: 0.170472 Jul 04 08:07:32.274657 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 260/546] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:32 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:32.463981 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6e78de8a-42c3-4da3-97b1-b9664b60e371 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:32.465134 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6e78de8a-42c3-4da3-97b1-b9664b60e371 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:32.474249 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e78de8a-42c3-4da3-97b1-b9664b60e371 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:32.474627 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e78de8a-42c3-4da3-97b1-b9664b60e371 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:32.475407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e78de8a-42c3-4da3-97b1-b9664b60e371 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:32.475840 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e78de8a-42c3-4da3-97b1-b9664b60e371 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:32.566211 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3767c2d9-5749-45f9-b96b-31ba2c944dd6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:32.567146 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3767c2d9-5749-45f9-b96b-31ba2c944dd6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:32.574223 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3767c2d9-5749-45f9-b96b-31ba2c944dd6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:32.574768 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3767c2d9-5749-45f9-b96b-31ba2c944dd6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:32.575437 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3767c2d9-5749-45f9-b96b-31ba2c944dd6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:32.575870 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3767c2d9-5749-45f9-b96b-31ba2c944dd6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:32.601802 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:32.607473 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3767c2d9-5749-45f9-b96b-31ba2c944dd6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046175 Jul 04 08:07:32.608044 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 261/547] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:32 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:32.619993 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6e78de8a-42c3-4da3-97b1-b9664b60e371 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:32.627957 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6e78de8a-42c3-4da3-97b1-b9664b60e371 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.169300 Jul 04 08:07:32.628521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 287/548] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:32 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:32.855864 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f10f8535-54ed-48b0-97b5-4a42fe1ff001 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:32.856756 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f10f8535-54ed-48b0-97b5-4a42fe1ff001 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:32.864144 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f10f8535-54ed-48b0-97b5-4a42fe1ff001 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:32.864577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f10f8535-54ed-48b0-97b5-4a42fe1ff001 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:32.865332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f10f8535-54ed-48b0-97b5-4a42fe1ff001 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:32.865793 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f10f8535-54ed-48b0-97b5-4a42fe1ff001 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.073481 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f10f8535-54ed-48b0-97b5-4a42fe1ff001 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:33.083453 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f10f8535-54ed-48b0-97b5-4a42fe1ff001 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.231763 Jul 04 08:07:33.090131 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 262/549] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:32 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:33.291471 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2e4d6cf4-3140-48d2-819f-4e1c0757ccb3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:33.292233 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2e4d6cf4-3140-48d2-819f-4e1c0757ccb3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:33.299679 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e4d6cf4-3140-48d2-819f-4e1c0757ccb3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:33.300311 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e4d6cf4-3140-48d2-819f-4e1c0757ccb3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.301276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e4d6cf4-3140-48d2-819f-4e1c0757ccb3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:33.301852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2e4d6cf4-3140-48d2-819f-4e1c0757ccb3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.476432 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2e4d6cf4-3140-48d2-819f-4e1c0757ccb3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:33.485417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2e4d6cf4-3140-48d2-819f-4e1c0757ccb3 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1654 microversion: 2.1 time: 0.197722 Jul 04 08:07:33.503341 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-908fdb7c-6d02-4ac9-be69-0cefd0ce58ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:33.508404 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 288/550] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:33 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1654 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:33.510222 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-908fdb7c-6d02-4ac9-be69-0cefd0ce58ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:33.510672 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-908fdb7c-6d02-4ac9-be69-0cefd0ce58ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.575048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-908fdb7c-6d02-4ac9-be69-0cefd0ce58ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Going to try to start instance {{(pid=117870) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 04 08:07:33.626438 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-908fdb7c-6d02-4ac9-be69-0cefd0ce58ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/action" status: 202 len: 0 microversion: 2.1 time: 0.127289 Jul 04 08:07:33.632827 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 263/551] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:07:33 2022] POST /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 08:07:33.641080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-720e022f-f371-4f7f-a43f-e31834328ac5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:33.642107 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-720e022f-f371-4f7f-a43f-e31834328ac5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:33.644577 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-50aa1258-36d8-4464-aee2-b5f0b0f2f40b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:33.649351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-50aa1258-36d8-4464-aee2-b5f0b0f2f40b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:33.650052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-720e022f-f371-4f7f-a43f-e31834328ac5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:33.650714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-720e022f-f371-4f7f-a43f-e31834328ac5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.651699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-720e022f-f371-4f7f-a43f-e31834328ac5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:33.652283 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-720e022f-f371-4f7f-a43f-e31834328ac5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.682592 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-50aa1258-36d8-4464-aee2-b5f0b0f2f40b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:33.696758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-50aa1258-36d8-4464-aee2-b5f0b0f2f40b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.700198 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-50aa1258-36d8-4464-aee2-b5f0b0f2f40b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:33.700649 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-50aa1258-36d8-4464-aee2-b5f0b0f2f40b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.784434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-50aa1258-36d8-4464-aee2-b5f0b0f2f40b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167570 Jul 04 08:07:33.786249 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 289/552] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:33 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:33.795846 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d0e00352-3720-40d7-b03f-1f544f1aa4c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:33.797004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d0e00352-3720-40d7-b03f-1f544f1aa4c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:33.804988 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d0e00352-3720-40d7-b03f-1f544f1aa4c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:33.805730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d0e00352-3720-40d7-b03f-1f544f1aa4c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.806711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d0e00352-3720-40d7-b03f-1f544f1aa4c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:33.808146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d0e00352-3720-40d7-b03f-1f544f1aa4c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:33.884045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-720e022f-f371-4f7f-a43f-e31834328ac5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:33.892665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-720e022f-f371-4f7f-a43f-e31834328ac5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1663 microversion: 2.1 time: 0.257599 Jul 04 08:07:33.894209 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 264/553] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:33 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1663 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:33.947973 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d0e00352-3720-40d7-b03f-1f544f1aa4c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:33.956193 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d0e00352-3720-40d7-b03f-1f544f1aa4c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.164985 Jul 04 08:07:33.957161 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 290/554] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:33 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:34.101117 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2ca9f255-7927-4fb2-9a6a-e08ff38c9d34 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:34.101670 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2ca9f255-7927-4fb2-9a6a-e08ff38c9d34 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:34.114156 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ca9f255-7927-4fb2-9a6a-e08ff38c9d34 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:34.114653 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ca9f255-7927-4fb2-9a6a-e08ff38c9d34 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:34.120824 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ca9f255-7927-4fb2-9a6a-e08ff38c9d34 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:34.121280 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ca9f255-7927-4fb2-9a6a-e08ff38c9d34 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:34.291753 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2ca9f255-7927-4fb2-9a6a-e08ff38c9d34 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:34.299817 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2ca9f255-7927-4fb2-9a6a-e08ff38c9d34 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.202918 Jul 04 08:07:34.300411 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 265/555] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:34 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:34.797445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-74caa99c-6cba-4540-ab94-d0ae0355cf1f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:34.798415 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-74caa99c-6cba-4540-ab94-d0ae0355cf1f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:34.806036 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74caa99c-6cba-4540-ab94-d0ae0355cf1f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:34.806485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74caa99c-6cba-4540-ab94-d0ae0355cf1f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:34.807258 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74caa99c-6cba-4540-ab94-d0ae0355cf1f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:34.807690 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74caa99c-6cba-4540-ab94-d0ae0355cf1f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:34.841327 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-74caa99c-6cba-4540-ab94-d0ae0355cf1f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047797 Jul 04 08:07:34.841849 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 291/556] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:34 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:34.912444 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0c6c8366-7b71-4170-a45d-eaa0db6cfd24 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:34.913054 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0c6c8366-7b71-4170-a45d-eaa0db6cfd24 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:34.920863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c6c8366-7b71-4170-a45d-eaa0db6cfd24 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:34.921325 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c6c8366-7b71-4170-a45d-eaa0db6cfd24 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:34.922164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c6c8366-7b71-4170-a45d-eaa0db6cfd24 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:34.922727 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c6c8366-7b71-4170-a45d-eaa0db6cfd24 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:34.975479 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bd9356a4-f6f7-4efa-a575-f22b2b1eb85e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:34.976089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bd9356a4-f6f7-4efa-a575-f22b2b1eb85e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:34.982549 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bd9356a4-f6f7-4efa-a575-f22b2b1eb85e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:34.983028 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bd9356a4-f6f7-4efa-a575-f22b2b1eb85e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:34.983818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bd9356a4-f6f7-4efa-a575-f22b2b1eb85e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:34.984254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bd9356a4-f6f7-4efa-a575-f22b2b1eb85e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:35.076172 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0c6c8366-7b71-4170-a45d-eaa0db6cfd24 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:35.084121 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0c6c8366-7b71-4170-a45d-eaa0db6cfd24 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1663 microversion: 2.1 time: 0.176001 Jul 04 08:07:35.084709 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 266/557] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:34 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:35.161530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bd9356a4-f6f7-4efa-a575-f22b2b1eb85e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:35.169873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bd9356a4-f6f7-4efa-a575-f22b2b1eb85e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.198893 Jul 04 08:07:35.170484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 292/558] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:34 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:35.317881 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b0efea47-6150-4ab7-9676-ac8d6d16740b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:35.318491 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b0efea47-6150-4ab7-9676-ac8d6d16740b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:35.325587 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b0efea47-6150-4ab7-9676-ac8d6d16740b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:35.326071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b0efea47-6150-4ab7-9676-ac8d6d16740b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:35.326857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b0efea47-6150-4ab7-9676-ac8d6d16740b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:35.327289 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b0efea47-6150-4ab7-9676-ac8d6d16740b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:35.484470 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b0efea47-6150-4ab7-9676-ac8d6d16740b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:35.493037 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b0efea47-6150-4ab7-9676-ac8d6d16740b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.179671 Jul 04 08:07:35.493614 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 267/559] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:35 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:35.854878 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7c63c1ed-8d49-445a-b591-7c293a2a47e9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:35.855827 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7c63c1ed-8d49-445a-b591-7c293a2a47e9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:35.863306 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c63c1ed-8d49-445a-b591-7c293a2a47e9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:35.863751 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c63c1ed-8d49-445a-b591-7c293a2a47e9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:35.864526 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c63c1ed-8d49-445a-b591-7c293a2a47e9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:35.864950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c63c1ed-8d49-445a-b591-7c293a2a47e9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:35.898852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7c63c1ed-8d49-445a-b591-7c293a2a47e9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047641 Jul 04 08:07:35.899486 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 293/560] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:35 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:36.101150 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-75cb50be-ae90-4798-bbca-18626bd5f8ce tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:36.101750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-75cb50be-ae90-4798-bbca-18626bd5f8ce tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:36.108719 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-75cb50be-ae90-4798-bbca-18626bd5f8ce tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:36.109166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-75cb50be-ae90-4798-bbca-18626bd5f8ce tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:36.110056 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-75cb50be-ae90-4798-bbca-18626bd5f8ce tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:36.111008 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-75cb50be-ae90-4798-bbca-18626bd5f8ce tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:36.189693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-54749678-5cf4-40cf-be2e-8c0408422fb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:36.190455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-54749678-5cf4-40cf-be2e-8c0408422fb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:36.196787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54749678-5cf4-40cf-be2e-8c0408422fb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:36.197236 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54749678-5cf4-40cf-be2e-8c0408422fb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:36.198036 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54749678-5cf4-40cf-be2e-8c0408422fb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:36.198468 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54749678-5cf4-40cf-be2e-8c0408422fb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:36.258704 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-75cb50be-ae90-4798-bbca-18626bd5f8ce tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:36.267370 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-75cb50be-ae90-4798-bbca-18626bd5f8ce tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1663 microversion: 2.1 time: 0.170078 Jul 04 08:07:36.268629 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 268/561] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:36 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:36.340130 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-54749678-5cf4-40cf-be2e-8c0408422fb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:36.348819 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-54749678-5cf4-40cf-be2e-8c0408422fb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.162858 Jul 04 08:07:36.349566 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 294/562] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:36 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:36.513815 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-64ebc1ba-4bc5-4511-91a1-2fda5a1e5a94 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:36.514855 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-64ebc1ba-4bc5-4511-91a1-2fda5a1e5a94 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:36.522392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-64ebc1ba-4bc5-4511-91a1-2fda5a1e5a94 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:36.522826 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-64ebc1ba-4bc5-4511-91a1-2fda5a1e5a94 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:36.523614 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-64ebc1ba-4bc5-4511-91a1-2fda5a1e5a94 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:36.524036 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-64ebc1ba-4bc5-4511-91a1-2fda5a1e5a94 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:36.664798 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-64ebc1ba-4bc5-4511-91a1-2fda5a1e5a94 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:36.676203 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-64ebc1ba-4bc5-4511-91a1-2fda5a1e5a94 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.167824 Jul 04 08:07:36.676798 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 269/563] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:36 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:36.912690 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c29a2ca9-7dd3-49b1-a804-e4db9749b12b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:36.913557 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c29a2ca9-7dd3-49b1-a804-e4db9749b12b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:36.915514 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:36.916213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:36.923725 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c29a2ca9-7dd3-49b1-a804-e4db9749b12b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:36.924444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c29a2ca9-7dd3-49b1-a804-e4db9749b12b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:36.925174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c29a2ca9-7dd3-49b1-a804-e4db9749b12b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:36.925609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c29a2ca9-7dd3-49b1-a804-e4db9749b12b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:36.957582 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c29a2ca9-7dd3-49b1-a804-e4db9749b12b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049154 Jul 04 08:07:36.958438 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 295/564] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:36 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:37.284697 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6d376196-2db1-40cb-925d-b24a7503a50d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:37.285335 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6d376196-2db1-40cb-925d-b24a7503a50d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:37.287356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:37.294017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6d376196-2db1-40cb-925d-b24a7503a50d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:37.294479 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6d376196-2db1-40cb-925d-b24a7503a50d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:37.295258 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6d376196-2db1-40cb-925d-b24a7503a50d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:37.295680 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6d376196-2db1-40cb-925d-b24a7503a50d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:37.371910 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-312f9cca-dd43-4bb4-85ce-f13faf695b5f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:37.372509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-312f9cca-dd43-4bb4-85ce-f13faf695b5f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:37.380239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-312f9cca-dd43-4bb4-85ce-f13faf695b5f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:37.380833 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-312f9cca-dd43-4bb4-85ce-f13faf695b5f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:37.381793 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-312f9cca-dd43-4bb4-85ce-f13faf695b5f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:37.382504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-312f9cca-dd43-4bb4-85ce-f13faf695b5f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:37.441265 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6d376196-2db1-40cb-925d-b24a7503a50d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:37.449340 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6d376196-2db1-40cb-925d-b24a7503a50d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1663 microversion: 2.1 time: 0.168698 Jul 04 08:07:37.449963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 270/565] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:37 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:37.537239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-312f9cca-dd43-4bb4-85ce-f13faf695b5f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:37.545001 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-312f9cca-dd43-4bb4-85ce-f13faf695b5f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.176851 Jul 04 08:07:37.545569 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 296/566] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:37 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:37.693363 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-02b3fbfd-0b4c-4389-b110-1f1da83be23c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:37.693999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-02b3fbfd-0b4c-4389-b110-1f1da83be23c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:37.700547 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-02b3fbfd-0b4c-4389-b110-1f1da83be23c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:37.700995 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-02b3fbfd-0b4c-4389-b110-1f1da83be23c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:37.701800 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-02b3fbfd-0b4c-4389-b110-1f1da83be23c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:37.702323 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-02b3fbfd-0b4c-4389-b110-1f1da83be23c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:37.835112 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-2725257b-efda-44c6-affe-e33557daf8d7 req-5015d650-8a5e-43da-b0ac-7b5a86c9bfa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf097eb-a2e5-4ce3-b0d9-1104988fe661", "name": "network-vif-plugged", "status": "completed", "tag": "664da2ec-3174-44ad-9296-0f70c9630416"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:37.844085 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2725257b-efda-44c6-affe-e33557daf8d7 req-5015d650-8a5e-43da-b0ac-7b5a86c9bfa9 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:37.844646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2725257b-efda-44c6-affe-e33557daf8d7 req-5015d650-8a5e-43da-b0ac-7b5a86c9bfa9 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:37.848919 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-02b3fbfd-0b4c-4389-b110-1f1da83be23c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:37.849745 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:37.858464 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-2725257b-efda-44c6-affe-e33557daf8d7 req-5015d650-8a5e-43da-b0ac-7b5a86c9bfa9 service nova] Creating event network-vif-plugged:664da2ec-3174-44ad-9296-0f70c9630416 for instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 on hv-cinder-79760 Jul 04 08:07:37.859080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-02b3fbfd-0b4c-4389-b110-1f1da83be23c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.169873 Jul 04 08:07:37.870181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 271/567] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:37 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:37.871197 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-2725257b-efda-44c6-affe-e33557daf8d7 req-5015d650-8a5e-43da-b0ac-7b5a86c9bfa9 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039756 Jul 04 08:07:37.872053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 297/568] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:37.973653 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9c8cd044-d3f4-44d5-8daa-dd78d7a309b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:37.974857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9c8cd044-d3f4-44d5-8daa-dd78d7a309b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:37.987249 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c8cd044-d3f4-44d5-8daa-dd78d7a309b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:37.987249 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c8cd044-d3f4-44d5-8daa-dd78d7a309b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:37.987249 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c8cd044-d3f4-44d5-8daa-dd78d7a309b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:37.987249 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c8cd044-d3f4-44d5-8daa-dd78d7a309b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:38.016298 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9c8cd044-d3f4-44d5-8daa-dd78d7a309b4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050128 Jul 04 08:07:38.016865 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 272/569] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:37 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:38.468004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6c7fe9d5-d1e7-4dff-b542-7510206363c5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:38.468656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6c7fe9d5-d1e7-4dff-b542-7510206363c5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:38.475949 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c7fe9d5-d1e7-4dff-b542-7510206363c5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:38.476388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c7fe9d5-d1e7-4dff-b542-7510206363c5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:38.477148 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c7fe9d5-d1e7-4dff-b542-7510206363c5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:38.477579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c7fe9d5-d1e7-4dff-b542-7510206363c5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:38.562180 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8cc86d38-d894-435e-ae63-75c290da20b0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:38.562817 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8cc86d38-d894-435e-ae63-75c290da20b0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:38.569721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cc86d38-d894-435e-ae63-75c290da20b0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:38.570166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cc86d38-d894-435e-ae63-75c290da20b0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:38.570940 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cc86d38-d894-435e-ae63-75c290da20b0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:38.571369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cc86d38-d894-435e-ae63-75c290da20b0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:38.620571 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6c7fe9d5-d1e7-4dff-b542-7510206363c5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:38.629501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6c7fe9d5-d1e7-4dff-b542-7510206363c5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1663 microversion: 2.1 time: 0.166214 Jul 04 08:07:38.630132 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 298/570] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:38 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1663 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:38.721754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8cc86d38-d894-435e-ae63-75c290da20b0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:38.730843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8cc86d38-d894-435e-ae63-75c290da20b0 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.172759 Jul 04 08:07:38.731415 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 273/571] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:38 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:38.881357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e8da8c8b-3e5a-475f-9345-a78e24dd18a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:38.882261 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e8da8c8b-3e5a-475f-9345-a78e24dd18a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:38.892513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e8da8c8b-3e5a-475f-9345-a78e24dd18a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:38.893279 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e8da8c8b-3e5a-475f-9345-a78e24dd18a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:38.894103 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e8da8c8b-3e5a-475f-9345-a78e24dd18a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:38.894540 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e8da8c8b-3e5a-475f-9345-a78e24dd18a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:39.029018 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-37b43717-256a-4699-b25d-5110ca920d4d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:39.030377 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-37b43717-256a-4699-b25d-5110ca920d4d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:39.037532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37b43717-256a-4699-b25d-5110ca920d4d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:39.038102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37b43717-256a-4699-b25d-5110ca920d4d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:39.038958 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37b43717-256a-4699-b25d-5110ca920d4d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:39.039594 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37b43717-256a-4699-b25d-5110ca920d4d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:39.042670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e8da8c8b-3e5a-475f-9345-a78e24dd18a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:39.055656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e8da8c8b-3e5a-475f-9345-a78e24dd18a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.181620 Jul 04 08:07:39.056351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 299/572] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:38 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:39.076993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-37b43717-256a-4699-b25d-5110ca920d4d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052310 Jul 04 08:07:39.077584 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 274/573] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:39 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:39.647330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d407246c-21fb-47b1-a0a9-1a39fa3472ca tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:39.647952 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d407246c-21fb-47b1-a0a9-1a39fa3472ca tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:39.655216 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d407246c-21fb-47b1-a0a9-1a39fa3472ca tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:39.655660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d407246c-21fb-47b1-a0a9-1a39fa3472ca tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:39.656437 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d407246c-21fb-47b1-a0a9-1a39fa3472ca tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:39.656869 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d407246c-21fb-47b1-a0a9-1a39fa3472ca tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:39.748565 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3b0006ff-d8c9-4e5f-a56a-8db8cc4368c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:39.749247 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3b0006ff-d8c9-4e5f-a56a-8db8cc4368c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:39.757119 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3b0006ff-d8c9-4e5f-a56a-8db8cc4368c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:39.757550 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3b0006ff-d8c9-4e5f-a56a-8db8cc4368c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:39.758385 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3b0006ff-d8c9-4e5f-a56a-8db8cc4368c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:39.758863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3b0006ff-d8c9-4e5f-a56a-8db8cc4368c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:39.833383 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d407246c-21fb-47b1-a0a9-1a39fa3472ca tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:39.841597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d407246c-21fb-47b1-a0a9-1a39fa3472ca tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1663 microversion: 2.1 time: 0.198152 Jul 04 08:07:39.842400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 300/574] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:39 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1663 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:39.913853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3b0006ff-d8c9-4e5f-a56a-8db8cc4368c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:39.922033 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3b0006ff-d8c9-4e5f-a56a-8db8cc4368c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.177707 Jul 04 08:07:39.922623 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 275/575] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:39 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:40.072119 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-10ef94b6-6555-4aff-abdd-106ca928a860 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:40.072631 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-10ef94b6-6555-4aff-abdd-106ca928a860 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:40.082753 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-10ef94b6-6555-4aff-abdd-106ca928a860 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:40.083475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-10ef94b6-6555-4aff-abdd-106ca928a860 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:40.084505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-10ef94b6-6555-4aff-abdd-106ca928a860 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:40.085259 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-10ef94b6-6555-4aff-abdd-106ca928a860 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:40.091340 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-25e781b4-2cf3-4449-bdf5-45882f088140 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:40.092470 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-25e781b4-2cf3-4449-bdf5-45882f088140 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:40.100198 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25e781b4-2cf3-4449-bdf5-45882f088140 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:40.100646 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25e781b4-2cf3-4449-bdf5-45882f088140 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:40.101424 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25e781b4-2cf3-4449-bdf5-45882f088140 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:40.101890 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-25e781b4-2cf3-4449-bdf5-45882f088140 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:40.136441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-25e781b4-2cf3-4449-bdf5-45882f088140 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050737 Jul 04 08:07:40.137099 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 276/576] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:40 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:40.243135 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-10ef94b6-6555-4aff-abdd-106ca928a860 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:40.254537 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-10ef94b6-6555-4aff-abdd-106ca928a860 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.186323 Jul 04 08:07:40.255121 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 301/577] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:40 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:40.864378 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f5c3ffc4-2ca7-46b4-aa79-fa81ea1ba6ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:40.864982 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f5c3ffc4-2ca7-46b4-aa79-fa81ea1ba6ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:40.872486 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f5c3ffc4-2ca7-46b4-aa79-fa81ea1ba6ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:40.872937 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f5c3ffc4-2ca7-46b4-aa79-fa81ea1ba6ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:40.873721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f5c3ffc4-2ca7-46b4-aa79-fa81ea1ba6ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:40.874144 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f5c3ffc4-2ca7-46b4-aa79-fa81ea1ba6ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:40.893830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:40.939808 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-726ef401-51a9-4d26-a89d-11bb7cf88771 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:40.940561 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-726ef401-51a9-4d26-a89d-11bb7cf88771 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:40.947559 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-726ef401-51a9-4d26-a89d-11bb7cf88771 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:40.947886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-726ef401-51a9-4d26-a89d-11bb7cf88771 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:40.948680 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-726ef401-51a9-4d26-a89d-11bb7cf88771 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:40.949104 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-726ef401-51a9-4d26-a89d-11bb7cf88771 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:41.026627 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f5c3ffc4-2ca7-46b4-aa79-fa81ea1ba6ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:41.037156 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f5c3ffc4-2ca7-46b4-aa79-fa81ea1ba6ab tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1663 microversion: 2.1 time: 0.177042 Jul 04 08:07:41.037843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 277/578] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:40 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1663 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:41.095850 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-726ef401-51a9-4d26-a89d-11bb7cf88771 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:41.104633 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-726ef401-51a9-4d26-a89d-11bb7cf88771 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.167915 Jul 04 08:07:41.105601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 302/579] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:40 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:41.149718 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-130cd72a-ac4a-41f3-8abc-ccbfa718bd24 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:41.150469 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-130cd72a-ac4a-41f3-8abc-ccbfa718bd24 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:41.159913 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-130cd72a-ac4a-41f3-8abc-ccbfa718bd24 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:41.160770 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-130cd72a-ac4a-41f3-8abc-ccbfa718bd24 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:41.162307 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-130cd72a-ac4a-41f3-8abc-ccbfa718bd24 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:41.163152 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-130cd72a-ac4a-41f3-8abc-ccbfa718bd24 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:41.208724 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-130cd72a-ac4a-41f3-8abc-ccbfa718bd24 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063479 Jul 04 08:07:41.209207 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 278/580] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:41 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:41.273198 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4160b906-f89c-4302-aca4-ba7482f26d8e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:41.274386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4160b906-f89c-4302-aca4-ba7482f26d8e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:41.280889 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4160b906-f89c-4302-aca4-ba7482f26d8e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:41.281342 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4160b906-f89c-4302-aca4-ba7482f26d8e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:41.282191 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4160b906-f89c-4302-aca4-ba7482f26d8e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:41.283449 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4160b906-f89c-4302-aca4-ba7482f26d8e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:41.449040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4160b906-f89c-4302-aca4-ba7482f26d8e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:41.456940 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4160b906-f89c-4302-aca4-ba7482f26d8e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.188363 Jul 04 08:07:41.457496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 303/581] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:41 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:42.056032 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a9e48748-9bd6-4398-a07a-4ad04324f1a4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:42.056644 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a9e48748-9bd6-4398-a07a-4ad04324f1a4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:42.064011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a9e48748-9bd6-4398-a07a-4ad04324f1a4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.064460 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a9e48748-9bd6-4398-a07a-4ad04324f1a4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.065233 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a9e48748-9bd6-4398-a07a-4ad04324f1a4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.065672 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a9e48748-9bd6-4398-a07a-4ad04324f1a4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.130053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c9cf2eca-21f0-4641-b721-2fff7f34272d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:42.132883 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c9cf2eca-21f0-4641-b721-2fff7f34272d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:42.140551 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9cf2eca-21f0-4641-b721-2fff7f34272d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.140997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9cf2eca-21f0-4641-b721-2fff7f34272d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.142481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9cf2eca-21f0-4641-b721-2fff7f34272d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.142601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9cf2eca-21f0-4641-b721-2fff7f34272d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.216859 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a9e48748-9bd6-4398-a07a-4ad04324f1a4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:42.226308 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a9e48748-9bd6-4398-a07a-4ad04324f1a4 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1663 microversion: 2.1 time: 0.174076 Jul 04 08:07:42.226986 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 279/582] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:42 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:42.244961 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-841d7932-cae2-4194-8e56-ce73d5c38fe8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:42.246732 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-841d7932-cae2-4194-8e56-ce73d5c38fe8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:42.258765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-841d7932-cae2-4194-8e56-ce73d5c38fe8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.259621 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-841d7932-cae2-4194-8e56-ce73d5c38fe8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.260989 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-841d7932-cae2-4194-8e56-ce73d5c38fe8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.261805 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-841d7932-cae2-4194-8e56-ce73d5c38fe8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.297807 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-841d7932-cae2-4194-8e56-ce73d5c38fe8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062346 Jul 04 08:07:42.298415 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 280/583] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:07:42 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 08:07:42.324706 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c9cf2eca-21f0-4641-b721-2fff7f34272d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:42.334109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c9cf2eca-21f0-4641-b721-2fff7f34272d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.213106 Jul 04 08:07:42.334712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 304/584] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:42 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:42.378703 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-094928ee-eede-4597-a471-0bc7b35240da tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:42.379184 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-094928ee-eede-4597-a471-0bc7b35240da tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:42.386170 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-094928ee-eede-4597-a471-0bc7b35240da tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.386623 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-094928ee-eede-4597-a471-0bc7b35240da tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.387432 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-094928ee-eede-4597-a471-0bc7b35240da tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.387897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-094928ee-eede-4597-a471-0bc7b35240da tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.414222 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-094928ee-eede-4597-a471-0bc7b35240da tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:07:42.474761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3fdad39f-68de-435b-89ea-578e4ecaf1aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:42.475418 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3fdad39f-68de-435b-89ea-578e4ecaf1aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:42.482146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3fdad39f-68de-435b-89ea-578e4ecaf1aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.482690 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3fdad39f-68de-435b-89ea-578e4ecaf1aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.483848 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3fdad39f-68de-435b-89ea-578e4ecaf1aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.484345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3fdad39f-68de-435b-89ea-578e4ecaf1aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.507943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-094928ee-eede-4597-a471-0bc7b35240da tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 204 len: 0 microversion: 2.1 time: 0.133407 Jul 04 08:07:42.509000 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 281/585] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:07:42 2022] DELETE /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:07:42.524104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-46274d76-99d1-4cda-810e-f0d96a0037b6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:42.524104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-46274d76-99d1-4cda-810e-f0d96a0037b6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:42.533013 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46274d76-99d1-4cda-810e-f0d96a0037b6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.533578 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46274d76-99d1-4cda-810e-f0d96a0037b6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.534314 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46274d76-99d1-4cda-810e-f0d96a0037b6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:42.534748 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46274d76-99d1-4cda-810e-f0d96a0037b6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:42.645295 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3fdad39f-68de-435b-89ea-578e4ecaf1aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:42.654250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3fdad39f-68de-435b-89ea-578e4ecaf1aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.183925 Jul 04 08:07:42.654840 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 305/586] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:42 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:42.699897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-46274d76-99d1-4cda-810e-f0d96a0037b6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:42.713117 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-46274d76-99d1-4cda-810e-f0d96a0037b6 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1683 microversion: 2.1 time: 0.198824 Jul 04 08:07:42.714163 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 282/587] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:42 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1683 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:43.244149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-54e8d6f2-3df9-4a49-972e-553112842e79 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:43.246246 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-54e8d6f2-3df9-4a49-972e-553112842e79 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:43.249654 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:43.255880 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54e8d6f2-3df9-4a49-972e-553112842e79 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:43.256331 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54e8d6f2-3df9-4a49-972e-553112842e79 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:43.257122 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54e8d6f2-3df9-4a49-972e-553112842e79 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:43.257543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54e8d6f2-3df9-4a49-972e-553112842e79 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:43.355111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5ef0ad7f-4164-40b5-8311-e0888aec07bb tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:43.356759 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5ef0ad7f-4164-40b5-8311-e0888aec07bb tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:43.367719 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ef0ad7f-4164-40b5-8311-e0888aec07bb tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:43.368545 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ef0ad7f-4164-40b5-8311-e0888aec07bb tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:43.369417 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ef0ad7f-4164-40b5-8311-e0888aec07bb tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:43.370091 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5ef0ad7f-4164-40b5-8311-e0888aec07bb tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:43.478877 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-54e8d6f2-3df9-4a49-972e-553112842e79 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:43.487221 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-54e8d6f2-3df9-4a49-972e-553112842e79 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1667 microversion: 2.1 time: 0.246845 Jul 04 08:07:43.488156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 306/588] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:43 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1667 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:43.494374 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-47b4eb83-a461-4410-a06b-1a3a25129aab req-646fa862-eff5-4672-8067-a2dd4299571f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab500b1-c48b-483c-978c-c34e45412a3a", "name": "network-vif-plugged", "status": "completed", "tag": "7cbefb7a-840f-4963-a04b-770627ab4955"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:43.505038 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-47b4eb83-a461-4410-a06b-1a3a25129aab req-646fa862-eff5-4672-8067-a2dd4299571f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:43.505481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-47b4eb83-a461-4410-a06b-1a3a25129aab req-646fa862-eff5-4672-8067-a2dd4299571f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:43.518200 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-47b4eb83-a461-4410-a06b-1a3a25129aab req-646fa862-eff5-4672-8067-a2dd4299571f service nova] Creating event network-vif-plugged:7cbefb7a-840f-4963-a04b-770627ab4955 for instance 3ab500b1-c48b-483c-978c-c34e45412a3a on hv-cinder-79760 Jul 04 08:07:43.524582 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-47b4eb83-a461-4410-a06b-1a3a25129aab req-646fa862-eff5-4672-8067-a2dd4299571f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034871 Jul 04 08:07:43.525615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 307/589] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:43.565950 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5ef0ad7f-4164-40b5-8311-e0888aec07bb tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:43.573779 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5ef0ad7f-4164-40b5-8311-e0888aec07bb tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.224080 Jul 04 08:07:43.574349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 283/590] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:43 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:43.676497 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0af2d26-932f-41dd-bf21-85eabe79eb78 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:43.677247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a0af2d26-932f-41dd-bf21-85eabe79eb78 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:43.685932 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0af2d26-932f-41dd-bf21-85eabe79eb78 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:43.686422 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0af2d26-932f-41dd-bf21-85eabe79eb78 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:43.687236 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0af2d26-932f-41dd-bf21-85eabe79eb78 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:43.687658 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0af2d26-932f-41dd-bf21-85eabe79eb78 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:43.743439 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2d8b7d78-9c71-4275-b2b2-a8125df479cb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:43.744134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2d8b7d78-9c71-4275-b2b2-a8125df479cb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:43.747284 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:43.758181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d8b7d78-9c71-4275-b2b2-a8125df479cb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:43.758645 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d8b7d78-9c71-4275-b2b2-a8125df479cb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:43.759427 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d8b7d78-9c71-4275-b2b2-a8125df479cb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:43.759903 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d8b7d78-9c71-4275-b2b2-a8125df479cb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:43.855729 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a0af2d26-932f-41dd-bf21-85eabe79eb78 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:43.864941 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a0af2d26-932f-41dd-bf21-85eabe79eb78 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1267 microversion: 2.1 time: 0.193591 Jul 04 08:07:43.865526 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 308/591] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:43 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:43.913261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2d8b7d78-9c71-4275-b2b2-a8125df479cb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:43.921278 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2d8b7d78-9c71-4275-b2b2-a8125df479cb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1683 microversion: 2.1 time: 0.184229 Jul 04 08:07:43.921944 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 284/592] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:43 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1683 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:44.593056 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e6a6011b-7d2a-459c-be85-ffa70a71745f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:44.593668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e6a6011b-7d2a-459c-be85-ffa70a71745f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:44.601851 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6a6011b-7d2a-459c-be85-ffa70a71745f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:44.602298 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6a6011b-7d2a-459c-be85-ffa70a71745f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:44.603057 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6a6011b-7d2a-459c-be85-ffa70a71745f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:44.603485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6a6011b-7d2a-459c-be85-ffa70a71745f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:44.751858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e6a6011b-7d2a-459c-be85-ffa70a71745f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:44.759758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e6a6011b-7d2a-459c-be85-ffa70a71745f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.172073 Jul 04 08:07:44.760337 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 309/593] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:44 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:44.885888 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9e177b05-ae00-4b3a-9dde-46288a894fa9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:44.886646 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9e177b05-ae00-4b3a-9dde-46288a894fa9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:44.896011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e177b05-ae00-4b3a-9dde-46288a894fa9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:44.896462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e177b05-ae00-4b3a-9dde-46288a894fa9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:44.897299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e177b05-ae00-4b3a-9dde-46288a894fa9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:44.897786 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e177b05-ae00-4b3a-9dde-46288a894fa9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:44.939032 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8913302b-6c32-4a5d-a9e6-e598e62edbbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:44.939574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8913302b-6c32-4a5d-a9e6-e598e62edbbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:44.946517 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8913302b-6c32-4a5d-a9e6-e598e62edbbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:44.946967 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8913302b-6c32-4a5d-a9e6-e598e62edbbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:44.947738 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8913302b-6c32-4a5d-a9e6-e598e62edbbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:44.948167 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8913302b-6c32-4a5d-a9e6-e598e62edbbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:45.041287 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9e177b05-ae00-4b3a-9dde-46288a894fa9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:45.049796 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9e177b05-ae00-4b3a-9dde-46288a894fa9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1455 microversion: 2.1 time: 0.169389 Jul 04 08:07:45.050425 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 285/594] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:44 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:45.066591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e25bb1b1-2446-42f0-9c4d-43bd474a1eaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:45.067197 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e25bb1b1-2446-42f0-9c4d-43bd474a1eaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:45.074998 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e25bb1b1-2446-42f0-9c4d-43bd474a1eaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:45.075447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e25bb1b1-2446-42f0-9c4d-43bd474a1eaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:45.076254 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e25bb1b1-2446-42f0-9c4d-43bd474a1eaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:45.076662 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e25bb1b1-2446-42f0-9c4d-43bd474a1eaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:45.086504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8913302b-6c32-4a5d-a9e6-e598e62edbbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:45.094579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8913302b-6c32-4a5d-a9e6-e598e62edbbb tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1683 microversion: 2.1 time: 0.159495 Jul 04 08:07:45.095189 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 310/595] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:44 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:45.210367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e25bb1b1-2446-42f0-9c4d-43bd474a1eaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:45.218499 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e25bb1b1-2446-42f0-9c4d-43bd474a1eaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1455 microversion: 2.1 time: 0.155845 Jul 04 08:07:45.219069 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 286/596] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:45 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1455 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:45.547601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2ef09a1d-e17f-4aa8-8cf3-06f36cdb22e1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:45.548255 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2ef09a1d-e17f-4aa8-8cf3-06f36cdb22e1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:45.557409 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2ef09a1d-e17f-4aa8-8cf3-06f36cdb22e1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:45.558088 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2ef09a1d-e17f-4aa8-8cf3-06f36cdb22e1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:45.559254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2ef09a1d-e17f-4aa8-8cf3-06f36cdb22e1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:45.559830 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2ef09a1d-e17f-4aa8-8cf3-06f36cdb22e1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:45.702061 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-2ef09a1d-e17f-4aa8-8cf3-06f36cdb22e1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lazy-loading 'services' on Instance uuid 1a747d37-45e9-43da-8a01-9be5126daadb {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:07:45.777595 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f036d2f3-9751-41aa-9ea1-deba3508dc4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:45.778283 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f036d2f3-9751-41aa-9ea1-deba3508dc4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:45.785786 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f036d2f3-9751-41aa-9ea1-deba3508dc4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:45.786288 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f036d2f3-9751-41aa-9ea1-deba3508dc4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:45.787214 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f036d2f3-9751-41aa-9ea1-deba3508dc4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:45.787648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f036d2f3-9751-41aa-9ea1-deba3508dc4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:45.848376 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2ef09a1d-e17f-4aa8-8cf3-06f36cdb22e1 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb/os-volume_attachments/51ac8b92-4807-4cd7-8d17-f6199a815e51" status: 202 len: 0 microversion: 2.1 time: 0.305021 Jul 04 08:07:45.848980 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 311/597] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:07:45 2022] DELETE /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb/os-volume_attachments/51ac8b92-4807-4cd7-8d17-f6199a815e51 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:07:45.965524 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f036d2f3-9751-41aa-9ea1-deba3508dc4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:45.973734 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f036d2f3-9751-41aa-9ea1-deba3508dc4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.200592 Jul 04 08:07:45.974326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 287/598] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:45 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:46.116338 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-64e9325e-1bf5-4716-a81b-a9ca7cab8a9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:46.117542 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-64e9325e-1bf5-4716-a81b-a9ca7cab8a9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:46.131776 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64e9325e-1bf5-4716-a81b-a9ca7cab8a9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:46.133038 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64e9325e-1bf5-4716-a81b-a9ca7cab8a9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:46.133935 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64e9325e-1bf5-4716-a81b-a9ca7cab8a9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:46.134432 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64e9325e-1bf5-4716-a81b-a9ca7cab8a9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:46.573915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-64e9325e-1bf5-4716-a81b-a9ca7cab8a9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:46.582374 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-64e9325e-1bf5-4716-a81b-a9ca7cab8a9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1683 microversion: 2.1 time: 0.473511 Jul 04 08:07:46.582969 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 312/599] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:46 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1683 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:46.992242 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-821b71b0-8be0-4a27-bc62-8f114dac9912 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:46.992843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-821b71b0-8be0-4a27-bc62-8f114dac9912 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:47.000030 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-821b71b0-8be0-4a27-bc62-8f114dac9912 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:47.000499 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-821b71b0-8be0-4a27-bc62-8f114dac9912 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:47.001288 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-821b71b0-8be0-4a27-bc62-8f114dac9912 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:47.001892 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-821b71b0-8be0-4a27-bc62-8f114dac9912 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:47.152987 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-821b71b0-8be0-4a27-bc62-8f114dac9912 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:47.160889 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-821b71b0-8be0-4a27-bc62-8f114dac9912 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.172471 Jul 04 08:07:47.161490 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 288/600] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:46 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:47.325131 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-d1e4a0a4-1ef8-4065-8329-36ee168f045c req-39a357f8-936c-4d51-953b-25d3d1d69554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cf097eb-a2e5-4ce3-b0d9-1104988fe661", "tag": "664da2ec-3174-44ad-9296-0f70c9630416"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:47.335494 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-d1e4a0a4-1ef8-4065-8329-36ee168f045c req-39a357f8-936c-4d51-953b-25d3d1d69554 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:47.335937 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-d1e4a0a4-1ef8-4065-8329-36ee168f045c req-39a357f8-936c-4d51-953b-25d3d1d69554 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:47.352558 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-d1e4a0a4-1ef8-4065-8329-36ee168f045c req-39a357f8-936c-4d51-953b-25d3d1d69554 service nova] Creating event network-changed:664da2ec-3174-44ad-9296-0f70c9630416 for instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 on hv-cinder-79760 Jul 04 08:07:47.358476 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-d1e4a0a4-1ef8-4065-8329-36ee168f045c req-39a357f8-936c-4d51-953b-25d3d1d69554 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037233 Jul 04 08:07:47.359143 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 313/601] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:47.600420 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4ba0c0b6-ef1c-4c31-a054-363682b7568e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:47.600938 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4ba0c0b6-ef1c-4c31-a054-363682b7568e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:47.608346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ba0c0b6-ef1c-4c31-a054-363682b7568e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:47.608794 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ba0c0b6-ef1c-4c31-a054-363682b7568e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:47.609574 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ba0c0b6-ef1c-4c31-a054-363682b7568e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:47.610030 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ba0c0b6-ef1c-4c31-a054-363682b7568e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:47.764696 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4ba0c0b6-ef1c-4c31-a054-363682b7568e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:47.779136 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4ba0c0b6-ef1c-4c31-a054-363682b7568e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1683 microversion: 2.1 time: 0.182731 Jul 04 08:07:47.780337 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 289/602] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:47 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1683 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:48.179269 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e2102a5e-0002-4838-85f1-a2e01db797a5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:48.180212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e2102a5e-0002-4838-85f1-a2e01db797a5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:48.189929 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2102a5e-0002-4838-85f1-a2e01db797a5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:48.190496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2102a5e-0002-4838-85f1-a2e01db797a5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:48.191303 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2102a5e-0002-4838-85f1-a2e01db797a5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:48.191737 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2102a5e-0002-4838-85f1-a2e01db797a5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:48.395652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e2102a5e-0002-4838-85f1-a2e01db797a5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:48.415180 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e2102a5e-0002-4838-85f1-a2e01db797a5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.240438 Jul 04 08:07:48.416993 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 314/603] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:48 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:48.803228 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4647553c-60ca-4416-b581-71b877d085ce tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:48.803948 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4647553c-60ca-4416-b581-71b877d085ce tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:48.813399 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4647553c-60ca-4416-b581-71b877d085ce tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:48.813930 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4647553c-60ca-4416-b581-71b877d085ce tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:48.814848 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4647553c-60ca-4416-b581-71b877d085ce tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:48.815487 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4647553c-60ca-4416-b581-71b877d085ce tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:48.894001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4647553c-60ca-4416-b581-71b877d085ce tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:48.903308 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4647553c-60ca-4416-b581-71b877d085ce tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1615 microversion: 2.1 time: 0.105120 Jul 04 08:07:48.904156 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 290/604] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:48 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1615 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:49.155837 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-18550b9a-44d3-45cd-b2e0-d19ebbb3f35d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:49.156714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-18550b9a-44d3-45cd-b2e0-d19ebbb3f35d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:49.164626 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18550b9a-44d3-45cd-b2e0-d19ebbb3f35d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:49.165073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18550b9a-44d3-45cd-b2e0-d19ebbb3f35d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:49.165969 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18550b9a-44d3-45cd-b2e0-d19ebbb3f35d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:49.166429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18550b9a-44d3-45cd-b2e0-d19ebbb3f35d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:49.193525 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:49.200831 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-18550b9a-44d3-45cd-b2e0-d19ebbb3f35d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:07:49.371316 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-18550b9a-44d3-45cd-b2e0-d19ebbb3f35d tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 204 len: 0 microversion: 2.1 time: 0.218842 Jul 04 08:07:49.372455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 315/605] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:07:49 2022] DELETE /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:07:49.385217 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-caa85db2-cf5b-4238-9ad0-3c0384e937b0 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:49.390933 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-caa85db2-cf5b-4238-9ad0-3c0384e937b0 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:49.401432 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-caa85db2-cf5b-4238-9ad0-3c0384e937b0 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:49.402296 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-caa85db2-cf5b-4238-9ad0-3c0384e937b0 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:49.403224 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-caa85db2-cf5b-4238-9ad0-3c0384e937b0 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:49.404004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-caa85db2-cf5b-4238-9ad0-3c0384e937b0 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:49.453798 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6aa9c002-c4fb-4dec-9c50-4881d40531ba tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:49.454903 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6aa9c002-c4fb-4dec-9c50-4881d40531ba tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:49.466623 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6aa9c002-c4fb-4dec-9c50-4881d40531ba tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:49.467060 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6aa9c002-c4fb-4dec-9c50-4881d40531ba tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:49.474424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6aa9c002-c4fb-4dec-9c50-4881d40531ba tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:49.475026 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6aa9c002-c4fb-4dec-9c50-4881d40531ba tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:49.643308 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6aa9c002-c4fb-4dec-9c50-4881d40531ba tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:49.654309 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-caa85db2-cf5b-4238-9ad0-3c0384e937b0 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:49.663438 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-caa85db2-cf5b-4238-9ad0-3c0384e937b0 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1514 microversion: 2.1 time: 0.285140 Jul 04 08:07:49.664040 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 291/606] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:49 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:49.664652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6aa9c002-c4fb-4dec-9c50-4881d40531ba tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.228991 Jul 04 08:07:49.669797 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-7fddb2bb-5d13-4188-ae15-4fa70a23b45f req-b2e1267d-2220-487b-8c1c-70e12d9017f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ce6703a-43b5-47a0-8d17-1794e718e3b1", "name": "network-vif-deleted", "tag": "525c4cce-65e1-4ea7-8d82-0a5a7a69ede9"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:49.678021 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 316/607] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:49 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:49.679769 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7fddb2bb-5d13-4188-ae15-4fa70a23b45f req-b2e1267d-2220-487b-8c1c-70e12d9017f7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:49.680218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7fddb2bb-5d13-4188-ae15-4fa70a23b45f req-b2e1267d-2220-487b-8c1c-70e12d9017f7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:49.692276 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-7fddb2bb-5d13-4188-ae15-4fa70a23b45f req-b2e1267d-2220-487b-8c1c-70e12d9017f7 service nova] Creating event network-vif-deleted:525c4cce-65e1-4ea7-8d82-0a5a7a69ede9 for instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 on hv-cinder-79760 Jul 04 08:07:49.698291 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-7fddb2bb-5d13-4188-ae15-4fa70a23b45f req-b2e1267d-2220-487b-8c1c-70e12d9017f7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Jul 04 08:07:49.699373 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 292/608] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:49.922152 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-726f0a5a-35bd-4870-895b-9bf00f86edbe tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:49.922942 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-726f0a5a-35bd-4870-895b-9bf00f86edbe tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:49.930851 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-726f0a5a-35bd-4870-895b-9bf00f86edbe tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:49.931593 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-726f0a5a-35bd-4870-895b-9bf00f86edbe tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:49.932891 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-726f0a5a-35bd-4870-895b-9bf00f86edbe tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:49.933593 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-726f0a5a-35bd-4870-895b-9bf00f86edbe tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:50.006579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-726f0a5a-35bd-4870-895b-9bf00f86edbe tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:50.014789 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-726f0a5a-35bd-4870-895b-9bf00f86edbe tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1615 microversion: 2.1 time: 0.097186 Jul 04 08:07:50.015395 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 317/609] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:49 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1615 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:50.682301 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e848d76c-8d3e-47ca-8269-78c677113d96 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:50.682922 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e848d76c-8d3e-47ca-8269-78c677113d96 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:50.690728 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e848d76c-8d3e-47ca-8269-78c677113d96 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:50.691182 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e848d76c-8d3e-47ca-8269-78c677113d96 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:50.691962 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e848d76c-8d3e-47ca-8269-78c677113d96 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:50.692398 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e848d76c-8d3e-47ca-8269-78c677113d96 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:50.695580 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e94a4d82-2c0e-462e-bbcd-845e9ae07368 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:50.696145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e94a4d82-2c0e-462e-bbcd-845e9ae07368 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:50.697186 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:07:50.702945 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e94a4d82-2c0e-462e-bbcd-845e9ae07368 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:50.703385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e94a4d82-2c0e-462e-bbcd-845e9ae07368 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:50.704129 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e94a4d82-2c0e-462e-bbcd-845e9ae07368 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:50.704801 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e94a4d82-2c0e-462e-bbcd-845e9ae07368 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:50.859665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e848d76c-8d3e-47ca-8269-78c677113d96 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:50.868079 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e848d76c-8d3e-47ca-8269-78c677113d96 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1514 microversion: 2.1 time: 0.190730 Jul 04 08:07:50.868792 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 293/610] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:50 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:50.887403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e94a4d82-2c0e-462e-bbcd-845e9ae07368 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:50.896242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e94a4d82-2c0e-462e-bbcd-845e9ae07368 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1371 microversion: 2.1 time: 0.204256 Jul 04 08:07:50.896873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 318/611] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:50 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:51.034077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d31734c4-5917-466e-aa15-6e15e3c6d2f8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:51.034685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d31734c4-5917-466e-aa15-6e15e3c6d2f8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:51.041248 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d31734c4-5917-466e-aa15-6e15e3c6d2f8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:51.041724 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d31734c4-5917-466e-aa15-6e15e3c6d2f8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:51.042489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d31734c4-5917-466e-aa15-6e15e3c6d2f8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:51.042920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d31734c4-5917-466e-aa15-6e15e3c6d2f8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:51.115351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d31734c4-5917-466e-aa15-6e15e3c6d2f8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:51.124045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d31734c4-5917-466e-aa15-6e15e3c6d2f8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1615 microversion: 2.1 time: 0.094592 Jul 04 08:07:51.124678 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 294/612] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:51 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:51.886203 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-95125718-3f71-437d-bf73-bf926ea9e0f8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:51.886859 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-95125718-3f71-437d-bf73-bf926ea9e0f8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:51.894214 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-95125718-3f71-437d-bf73-bf926ea9e0f8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:51.894682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-95125718-3f71-437d-bf73-bf926ea9e0f8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:51.895470 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-95125718-3f71-437d-bf73-bf926ea9e0f8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:51.895893 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-95125718-3f71-437d-bf73-bf926ea9e0f8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:51.913432 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fc3e058f-e9c9-4462-8c81-3253a3abad7b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:51.914048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fc3e058f-e9c9-4462-8c81-3253a3abad7b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:51.921543 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc3e058f-e9c9-4462-8c81-3253a3abad7b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:51.922246 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc3e058f-e9c9-4462-8c81-3253a3abad7b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:51.923061 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc3e058f-e9c9-4462-8c81-3253a3abad7b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:51.923499 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc3e058f-e9c9-4462-8c81-3253a3abad7b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:52.047930 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-95125718-3f71-437d-bf73-bf926ea9e0f8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:52.058823 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-95125718-3f71-437d-bf73-bf926ea9e0f8 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1514 microversion: 2.1 time: 0.176213 Jul 04 08:07:52.059898 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 319/613] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:51 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:52.079972 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fc3e058f-e9c9-4462-8c81-3253a3abad7b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:52.088063 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fc3e058f-e9c9-4462-8c81-3253a3abad7b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1565 microversion: 2.1 time: 0.178520 Jul 04 08:07:52.088630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 295/614] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:51 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:52.106668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-af7fafea-0284-493e-be92-17e2e87efe77 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:52.107180 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-af7fafea-0284-493e-be92-17e2e87efe77 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:52.113694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af7fafea-0284-493e-be92-17e2e87efe77 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:52.114195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af7fafea-0284-493e-be92-17e2e87efe77 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:52.115098 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af7fafea-0284-493e-be92-17e2e87efe77 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:52.115604 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af7fafea-0284-493e-be92-17e2e87efe77 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:52.143205 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d160b6e9-47be-49f9-8fdb-6d6e0c729b06 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:52.144259 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d160b6e9-47be-49f9-8fdb-6d6e0c729b06 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:52.150708 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d160b6e9-47be-49f9-8fdb-6d6e0c729b06 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:52.151155 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d160b6e9-47be-49f9-8fdb-6d6e0c729b06 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:52.151920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d160b6e9-47be-49f9-8fdb-6d6e0c729b06 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:52.152346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d160b6e9-47be-49f9-8fdb-6d6e0c729b06 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:52.208997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-af7fafea-0284-493e-be92-17e2e87efe77 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106133 Jul 04 08:07:52.209677 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 320/615] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jul 4 08:07:52 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:52.219476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d160b6e9-47be-49f9-8fdb-6d6e0c729b06 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:52.228098 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d160b6e9-47be-49f9-8fdb-6d6e0c729b06 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1327 microversion: 2.1 time: 0.089415 Jul 04 08:07:52.228716 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 296/616] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:52 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1327 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:53.082386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-634a0903-b80f-461b-a7ae-24ff4105fac2 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:53.083002 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-634a0903-b80f-461b-a7ae-24ff4105fac2 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:53.089499 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-634a0903-b80f-461b-a7ae-24ff4105fac2 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:53.089986 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-634a0903-b80f-461b-a7ae-24ff4105fac2 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:53.091037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-634a0903-b80f-461b-a7ae-24ff4105fac2 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:53.091476 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-634a0903-b80f-461b-a7ae-24ff4105fac2 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:53.246858 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:53.247968 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:53.259501 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:53.259964 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:53.260764 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:53.261198 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:53.310525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:53.311305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:53.311941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lazy-loading 'fault' on Instance uuid 3ce6703a-43b5-47a0-8d17-1794e718e3b1 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:07:53.334737 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-634a0903-b80f-461b-a7ae-24ff4105fac2 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:53.344575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-634a0903-b80f-461b-a7ae-24ff4105fac2 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1514 microversion: 2.1 time: 0.271218 Jul 04 08:07:53.355400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 321/617] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:53 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:53.364636 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-600b4403-45dd-4d61-98f3-961760a0b089 req-f8550e9f-f90d-4c49-8b40-27dffaa7d936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab500b1-c48b-483c-978c-c34e45412a3a", "tag": "7cbefb7a-840f-4963-a04b-770627ab4955"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:53.373886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-600b4403-45dd-4d61-98f3-961760a0b089 req-f8550e9f-f90d-4c49-8b40-27dffaa7d936 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:53.374459 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-600b4403-45dd-4d61-98f3-961760a0b089 req-f8550e9f-f90d-4c49-8b40-27dffaa7d936 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:53.382698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:53.391040 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ded0be45-22d2-4137-8c43-a6e2dba2a430 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 200 len: 1332 microversion: 2.1 time: 0.149530 Jul 04 08:07:53.392180 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 297/618] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:53 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 1332 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:53.395567 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-600b4403-45dd-4d61-98f3-961760a0b089 req-f8550e9f-f90d-4c49-8b40-27dffaa7d936 service nova] Creating event network-changed:7cbefb7a-840f-4963-a04b-770627ab4955 for instance 3ab500b1-c48b-483c-978c-c34e45412a3a on hv-cinder-79760 Jul 04 08:07:53.401670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-600b4403-45dd-4d61-98f3-961760a0b089 req-f8550e9f-f90d-4c49-8b40-27dffaa7d936 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047261 Jul 04 08:07:53.405407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 322/619] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:54.074016 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-f9698f92-1c10-4023-b3f4-fe39e8c844dc req-d5e613bf-25d0-4698-ab67-965b509b1bea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a747d37-45e9-43da-8a01-9be5126daadb", "name": "network-vif-deleted", "tag": "ddeb972a-8e58-4c3c-8173-9a3c4a88ec2d"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:54.090338 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f9698f92-1c10-4023-b3f4-fe39e8c844dc req-d5e613bf-25d0-4698-ab67-965b509b1bea service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:54.091038 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f9698f92-1c10-4023-b3f4-fe39e8c844dc req-d5e613bf-25d0-4698-ab67-965b509b1bea service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:54.110840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-f9698f92-1c10-4023-b3f4-fe39e8c844dc req-d5e613bf-25d0-4698-ab67-965b509b1bea service nova] Creating event network-vif-deleted:ddeb972a-8e58-4c3c-8173-9a3c4a88ec2d for instance 1a747d37-45e9-43da-8a01-9be5126daadb on hv-cinder-79760 Jul 04 08:07:54.126794 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-f9698f92-1c10-4023-b3f4-fe39e8c844dc req-d5e613bf-25d0-4698-ab67-965b509b1bea service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062526 Jul 04 08:07:54.129223 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 298/620] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:07:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:54.365423 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:54.367117 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:54.374578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:54.374982 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:54.376198 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:54.376585 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:54.413314 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:54.415272 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:54.424266 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:54.424851 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:54.425312 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lazy-loading 'fault' on Instance uuid 1a747d37-45e9-43da-8a01-9be5126daadb {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:07:54.426734 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:54.427428 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:54.428346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:54.430095 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:54.451458 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 HTTP/1.1 Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:07:54.453699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:07:54.455318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '3ce6703a-43b5-47a0-8d17-1794e718e3b1'} Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:07:54.456577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:07:54.458941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:54.460303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:07:54.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2a6a065d-e1f2-432e-a10b-966c92028a28 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 404 len: 111 microversion: 2.1 time: 0.053671 Jul 04 08:07:54.461929 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 299/621] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:54 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 08:07:54.470329 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7ae2b980-b910-4f74-b125-d992d9d7f333 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '.version_select at 0x7f05e55c9ca0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:54.483755 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34b2b4070d344d7ca07a99985678467a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de1b2d9c55f4af7b6793ac472a6d408', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:54.494107 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7ae2b980-b910-4f74-b125-d992d9d7f333 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498478526" status: 202 len: 0 microversion: 2.1 time: 0.027157 Jul 04 08:07:54.494390 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-572bd95b-699e-4931-9a18-0986b3382b2b tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 200 len: 1309 microversion: 2.1 time: 0.134591 Jul 04 08:07:54.495349 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 323/622] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:54 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 1309 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:54.496208 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 300/623] 10.222.0.43 () {58 vars in 1220 bytes} [Mon Jul 4 08:07:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498478526 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 08:07:55.191791 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d1800aad-1e2c-4bab-ac20-5cc33dc61204 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: .version_select at 0x7f05e5696f70>, body: {"keypair": {"name": "tempest-keypair-292627276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJyT06qflBwMBGNWmjPqQ1vFtazG11QJmrPutHyJsGVPIx8Gz4l3/GHEr/AMzK8RTxi7EPz1RjmagNA7+JF58gWwqEBbpO+s+7r4kzU+8nscQIyX9nRHEUZ6XpJ9rDtj5Q=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:55.207303 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-d1800aad-1e2c-4bab-ac20-5cc33dc61204 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for project de5226d001fb47b399172b6633fec844. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:07:55.211685 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-d1800aad-1e2c-4bab-ac20-5cc33dc61204 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for user 126ba607541e4c4895b47b4b7602ce01 and project de5226d001fb47b399172b6633fec844. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:07:55.239404 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d1800aad-1e2c-4bab-ac20-5cc33dc61204 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053275 Jul 04 08:07:55.240015 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 324/624] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:07:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:07:55.514942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:55.515713 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] [instance: 1a747d37-45e9-43da-8a01-9be5126daadb] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:55.524158 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:55.524793 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:55.525667 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:55.526080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:55.544588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] HTTP exception thrown: Instance 1a747d37-45e9-43da-8a01-9be5126daadb could not be found. Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Request method failure captured: Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb HTTP/1.1 Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp9DDKUVmio69_HR0f_U2jjG6iPIj1tiltm_kB9JNsoGA1r4HaDBl5K5Q_HyK8T5iQARgTzAEgzGA3sbESzeLFKKEOBxuuNVOc3RBg4mgrRrIFFKkcGwGMCVnvG0qpV_MGEaAUBUQ1_oEFatRMgdQ9iYmoOmKf5LkXlp-JvcezsUf6g Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 6de1b2d9c55f4af7b6793ac472a6d408 Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesSnapshotTestJSON-383634651 Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:07:55.546407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6de1b2d9c55f4af7b6793ac472a6d408"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/6de1b2d9c55f4af7b6793ac472a6d408"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/6de1b2d9c55f4af7b6793ac472a6d408"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_6de1b2d9c55f4af7b6793ac472a6d408", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesSnapshotTestJSON-383634651 Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 6de1b2d9c55f4af7b6793ac472a6d408 Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-383634651 Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesSnapshotTestJSON-383634651-project Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 34b2b4070d344d7ca07a99985678467a Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesSnapshotTestJSON-383634651-project Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 1a747d37-45e9-43da-8a01-9be5126daadb could not be found. Jul 04 08:07:55.549004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '1a747d37-45e9-43da-8a01-9be5126daadb'} Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a747d37-45e9-43da-8a01-9be5126daadb could not be found. Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:07:55.550915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a747d37-45e9-43da-8a01-9be5126daadb could not be found. Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a747d37-45e9-43da-8a01-9be5126daadb could not be found. Jul 04 08:07:55.554600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:07:55.556839 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] Returning 404 to user: Instance 1a747d37-45e9-43da-8a01-9be5126daadb could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:07:55.556839 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bf169d22-5947-4a73-82b8-840f2a1dff16 tempest-VolumesSnapshotTestJSON-383634651 tempest-VolumesSnapshotTestJSON-383634651-project] 10.222.0.43 "GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb" status: 404 len: 111 microversion: 2.1 time: 0.040060 Jul 04 08:07:55.556839 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 301/625] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:55 2022] GET /compute/v2.1/servers/1a747d37-45e9-43da-8a01-9be5126daadb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:07:56.691578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-620027611", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e86146d1-c8e4-49f2-af91-e63989951c39"}], "security_groups": [{"name": "tempest-securitygroup--932870152"}], "key_name": "tempest-keypair-292627276", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:07:56.802992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] validate_networks() for [('e86146d1-c8e4-49f2-af91-e63989951c39', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:07:57.233555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:07:57.234073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:07:57.234607 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:07:57.235059 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:07:57.235513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:07:57.245476 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:57.245714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:57.246409 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:57.246830 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:57.270066 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for project de5226d001fb47b399172b6633fec844. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:07:57.274345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for user 126ba607541e4c4895b47b4b7602ce01 and project de5226d001fb47b399172b6633fec844. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:07:57.287798 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:07:57.290178 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:07:57.340729 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2039756c-74a4-4056-8d7a-823bfc16c0d8 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.654978 Jul 04 08:07:57.341641 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 325/626] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:07:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 08:07:57.353239 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bf95dcdf-b1d8-4f29-b7f2-1a1babc9465d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:57.354008 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bf95dcdf-b1d8-4f29-b7f2-1a1babc9465d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:57.422045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bf95dcdf-b1d8-4f29-b7f2-1a1babc9465d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:57.430883 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bf95dcdf-b1d8-4f29-b7f2-1a1babc9465d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1240 microversion: 2.1 time: 0.082304 Jul 04 08:07:57.431421 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 302/627] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:57 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:07:58.448544 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-99f02b83-aed4-47f3-a627-0bdb6f5eb364 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:58.449155 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-99f02b83-aed4-47f3-a627-0bdb6f5eb364 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:58.456651 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-99f02b83-aed4-47f3-a627-0bdb6f5eb364 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:58.457125 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-99f02b83-aed4-47f3-a627-0bdb6f5eb364 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:58.457936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-99f02b83-aed4-47f3-a627-0bdb6f5eb364 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:58.458370 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-99f02b83-aed4-47f3-a627-0bdb6f5eb364 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:58.542285 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-99f02b83-aed4-47f3-a627-0bdb6f5eb364 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:58.550289 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-99f02b83-aed4-47f3-a627-0bdb6f5eb364 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1244 microversion: 2.1 time: 0.106263 Jul 04 08:07:58.550878 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 326/628] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:58 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1244 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:07:59.567659 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-def8c41f-c2b2-4876-a7d6-7d7312e6debd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:07:59.568405 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-def8c41f-c2b2-4876-a7d6-7d7312e6debd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:07:59.574773 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-def8c41f-c2b2-4876-a7d6-7d7312e6debd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:59.575242 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-def8c41f-c2b2-4876-a7d6-7d7312e6debd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:59.576026 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-def8c41f-c2b2-4876-a7d6-7d7312e6debd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:07:59.576493 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-def8c41f-c2b2-4876-a7d6-7d7312e6debd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:07:59.647398 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-def8c41f-c2b2-4876-a7d6-7d7312e6debd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:07:59.655832 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-def8c41f-c2b2-4876-a7d6-7d7312e6debd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1244 microversion: 2.1 time: 0.092172 Jul 04 08:07:59.656496 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 303/629] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:07:59 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:00.672778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-61af9edb-a091-4c2f-9d34-818dc857cfaf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:00.673448 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-61af9edb-a091-4c2f-9d34-818dc857cfaf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:00.681191 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61af9edb-a091-4c2f-9d34-818dc857cfaf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:00.681658 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61af9edb-a091-4c2f-9d34-818dc857cfaf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:00.682438 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61af9edb-a091-4c2f-9d34-818dc857cfaf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:00.682888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61af9edb-a091-4c2f-9d34-818dc857cfaf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:00.758311 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-61af9edb-a091-4c2f-9d34-818dc857cfaf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:00.766926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-61af9edb-a091-4c2f-9d34-818dc857cfaf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1292 microversion: 2.1 time: 0.097925 Jul 04 08:08:00.767496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 327/630] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:00 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:01.784566 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-53552bc7-8028-4ae8-92b7-75b39dfe2ccc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:01.785193 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-53552bc7-8028-4ae8-92b7-75b39dfe2ccc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:01.792616 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-53552bc7-8028-4ae8-92b7-75b39dfe2ccc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:01.793749 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-53552bc7-8028-4ae8-92b7-75b39dfe2ccc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:01.794543 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-53552bc7-8028-4ae8-92b7-75b39dfe2ccc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:01.794974 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-53552bc7-8028-4ae8-92b7-75b39dfe2ccc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:01.998600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-53552bc7-8028-4ae8-92b7-75b39dfe2ccc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:02.006949 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-53552bc7-8028-4ae8-92b7-75b39dfe2ccc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.226311 Jul 04 08:08:02.007534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 304/631] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:01 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:02.544815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-90761f02-aff1-41ce-bef1-7397e1bde68f req-cb219f42-2d68-4914-a7dc-169d4bc15c1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9919b8-5ba1-4472-b2cc-1faabba0742d", "tag": "560a2ae0-d66b-4604-b2a4-4879a9ad91a3"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:02.554670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-90761f02-aff1-41ce-bef1-7397e1bde68f req-cb219f42-2d68-4914-a7dc-169d4bc15c1a service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:02.555277 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-90761f02-aff1-41ce-bef1-7397e1bde68f req-cb219f42-2d68-4914-a7dc-169d4bc15c1a service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:02.575901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-90761f02-aff1-41ce-bef1-7397e1bde68f req-cb219f42-2d68-4914-a7dc-169d4bc15c1a service nova] Creating event network-changed:560a2ae0-d66b-4604-b2a4-4879a9ad91a3 for instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d on hv-cinder-79760 Jul 04 08:08:02.581048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-90761f02-aff1-41ce-bef1-7397e1bde68f req-cb219f42-2d68-4914-a7dc-169d4bc15c1a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039812 Jul 04 08:08:02.582377 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 328/632] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:08:03.023982 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b32ed307-1f3b-4dfb-bfcb-daa89e555887 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:03.024660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b32ed307-1f3b-4dfb-bfcb-daa89e555887 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:03.031974 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b32ed307-1f3b-4dfb-bfcb-daa89e555887 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:03.032454 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b32ed307-1f3b-4dfb-bfcb-daa89e555887 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:03.033357 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b32ed307-1f3b-4dfb-bfcb-daa89e555887 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:03.033834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b32ed307-1f3b-4dfb-bfcb-daa89e555887 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:03.385866 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b32ed307-1f3b-4dfb-bfcb-daa89e555887 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:03.397437 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b32ed307-1f3b-4dfb-bfcb-daa89e555887 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.377268 Jul 04 08:08:03.398193 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 305/633] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:03 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:04.420400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-13068b79-011b-4b56-8265-821d90dae4c1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:04.420953 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-13068b79-011b-4b56-8265-821d90dae4c1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:04.427281 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-13068b79-011b-4b56-8265-821d90dae4c1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:04.427772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-13068b79-011b-4b56-8265-821d90dae4c1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:04.428580 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-13068b79-011b-4b56-8265-821d90dae4c1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:04.429003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-13068b79-011b-4b56-8265-821d90dae4c1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:04.582859 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-13068b79-011b-4b56-8265-821d90dae4c1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:04.591530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-13068b79-011b-4b56-8265-821d90dae4c1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.175956 Jul 04 08:08:04.592109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 329/634] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:04 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:05.609501 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-636c3025-2740-4794-8034-53923c7726dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:05.610305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-636c3025-2740-4794-8034-53923c7726dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:05.617722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-636c3025-2740-4794-8034-53923c7726dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:05.618185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-636c3025-2740-4794-8034-53923c7726dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:05.619200 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-636c3025-2740-4794-8034-53923c7726dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:05.619656 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-636c3025-2740-4794-8034-53923c7726dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:05.756679 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-636c3025-2740-4794-8034-53923c7726dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:05.765214 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-636c3025-2740-4794-8034-53923c7726dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.159990 Jul 04 08:08:05.765811 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 306/635] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:05 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:06.786282 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5c8460c9-ada5-4609-a7a9-a533c4921df3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:06.787077 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5c8460c9-ada5-4609-a7a9-a533c4921df3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:06.796745 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c8460c9-ada5-4609-a7a9-a533c4921df3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:06.797321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c8460c9-ada5-4609-a7a9-a533c4921df3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:06.798415 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c8460c9-ada5-4609-a7a9-a533c4921df3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:06.799033 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c8460c9-ada5-4609-a7a9-a533c4921df3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:06.946716 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5c8460c9-ada5-4609-a7a9-a533c4921df3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:06.955194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5c8460c9-ada5-4609-a7a9-a533c4921df3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.175219 Jul 04 08:08:06.955806 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 330/636] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:06 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:07.971897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:07.976710 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-19845786-52de-4a65-8155-21f84634983c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:07.977311 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-19845786-52de-4a65-8155-21f84634983c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:07.984072 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19845786-52de-4a65-8155-21f84634983c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:07.984452 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19845786-52de-4a65-8155-21f84634983c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:07.985215 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19845786-52de-4a65-8155-21f84634983c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:07.985658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19845786-52de-4a65-8155-21f84634983c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:08.118571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-19845786-52de-4a65-8155-21f84634983c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:08.126668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-19845786-52de-4a65-8155-21f84634983c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.157042 Jul 04 08:08:08.127595 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 307/637] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:07 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:09.144273 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-036490dc-3461-4265-8e69-0ffa3996879d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:09.144921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-036490dc-3461-4265-8e69-0ffa3996879d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:09.146976 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:09.147640 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=10 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:09.156173 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-036490dc-3461-4265-8e69-0ffa3996879d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:09.156703 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-036490dc-3461-4265-8e69-0ffa3996879d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:09.157539 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-036490dc-3461-4265-8e69-0ffa3996879d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:09.158158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-036490dc-3461-4265-8e69-0ffa3996879d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:09.307917 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-036490dc-3461-4265-8e69-0ffa3996879d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:09.318794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-036490dc-3461-4265-8e69-0ffa3996879d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.178484 Jul 04 08:08:09.319518 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 331/638] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:09 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:10.337304 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-730aa53f-c350-4329-adbf-051c0d1ffe97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:10.337913 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-730aa53f-c350-4329-adbf-051c0d1ffe97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:10.344873 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-730aa53f-c350-4329-adbf-051c0d1ffe97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:10.345349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-730aa53f-c350-4329-adbf-051c0d1ffe97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:10.346144 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-730aa53f-c350-4329-adbf-051c0d1ffe97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:10.346657 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-730aa53f-c350-4329-adbf-051c0d1ffe97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:10.505755 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-730aa53f-c350-4329-adbf-051c0d1ffe97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:10.517435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-730aa53f-c350-4329-adbf-051c0d1ffe97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.184103 Jul 04 08:08:10.518334 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 308/639] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:10 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:11.538061 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c9066d66-6487-4c68-adcb-45d555e88daf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:11.539044 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c9066d66-6487-4c68-adcb-45d555e88daf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:11.547748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9066d66-6487-4c68-adcb-45d555e88daf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:11.548675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9066d66-6487-4c68-adcb-45d555e88daf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:11.549556 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9066d66-6487-4c68-adcb-45d555e88daf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:11.550180 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9066d66-6487-4c68-adcb-45d555e88daf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:11.691985 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c9066d66-6487-4c68-adcb-45d555e88daf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:11.700090 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c9066d66-6487-4c68-adcb-45d555e88daf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.166814 Jul 04 08:08:11.700659 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 332/640] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:11 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:11.713797 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-5f1d32a2-f758-45fd-b0cf-8134303ee876 req-d25e9ae1-4ea8-4040-937c-b4fa505bcf19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9919b8-5ba1-4472-b2cc-1faabba0742d", "name": "network-vif-plugged", "status": "completed", "tag": "560a2ae0-d66b-4604-b2a4-4879a9ad91a3"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:11.722940 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-5f1d32a2-f758-45fd-b0cf-8134303ee876 req-d25e9ae1-4ea8-4040-937c-b4fa505bcf19 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:11.723612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-5f1d32a2-f758-45fd-b0cf-8134303ee876 req-d25e9ae1-4ea8-4040-937c-b4fa505bcf19 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:11.735203 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-5f1d32a2-f758-45fd-b0cf-8134303ee876 req-d25e9ae1-4ea8-4040-937c-b4fa505bcf19 service nova] Creating event network-vif-plugged:560a2ae0-d66b-4604-b2a4-4879a9ad91a3 for instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d on hv-cinder-79760 Jul 04 08:08:11.740877 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-5f1d32a2-f758-45fd-b0cf-8134303ee876 req-d25e9ae1-4ea8-4040-937c-b4fa505bcf19 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039986 Jul 04 08:08:11.741489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 309/641] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:08:12.718121 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b272fe70-5c48-4f08-ac2b-38193457ad58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:12.718814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b272fe70-5c48-4f08-ac2b-38193457ad58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:12.726723 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b272fe70-5c48-4f08-ac2b-38193457ad58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:12.727192 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b272fe70-5c48-4f08-ac2b-38193457ad58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:12.728194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b272fe70-5c48-4f08-ac2b-38193457ad58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:12.728690 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b272fe70-5c48-4f08-ac2b-38193457ad58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:12.734390 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:12.903197 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b272fe70-5c48-4f08-ac2b-38193457ad58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:12.911353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b272fe70-5c48-4f08-ac2b-38193457ad58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1365 microversion: 2.1 time: 0.198021 Jul 04 08:08:12.911948 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 333/642] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:12 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:13.930626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f6c41c35-6b05-4312-b857-08b75babd8a0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:13.931209 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f6c41c35-6b05-4312-b857-08b75babd8a0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:13.933277 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:13.940274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6c41c35-6b05-4312-b857-08b75babd8a0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:13.940728 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6c41c35-6b05-4312-b857-08b75babd8a0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:13.941502 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6c41c35-6b05-4312-b857-08b75babd8a0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:13.941978 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6c41c35-6b05-4312-b857-08b75babd8a0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:14.091624 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f6c41c35-6b05-4312-b857-08b75babd8a0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:14.099787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f6c41c35-6b05-4312-b857-08b75babd8a0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1555 microversion: 2.1 time: 0.174234 Jul 04 08:08:14.100442 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 310/643] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:13 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:14.119827 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a09d776d-c2b9-438e-8b6b-07b9c299ee65 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:14.120493 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a09d776d-c2b9-438e-8b6b-07b9c299ee65 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:14.123058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:14.130039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a09d776d-c2b9-438e-8b6b-07b9c299ee65 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:14.130481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a09d776d-c2b9-438e-8b6b-07b9c299ee65 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:14.131450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a09d776d-c2b9-438e-8b6b-07b9c299ee65 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:14.131888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a09d776d-c2b9-438e-8b6b-07b9c299ee65 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:14.218813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a09d776d-c2b9-438e-8b6b-07b9c299ee65 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103422 Jul 04 08:08:14.219844 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 334/644] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jul 4 08:08:14 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:08:15.263778 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-2987aec0-7ce4-43fe-bb32-83db7ed4e8de req-699f00e4-3cc7-43f9-b8f5-1a99654d3ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9919b8-5ba1-4472-b2cc-1faabba0742d", "tag": "560a2ae0-d66b-4604-b2a4-4879a9ad91a3"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:15.273197 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-2987aec0-7ce4-43fe-bb32-83db7ed4e8de req-699f00e4-3cc7-43f9-b8f5-1a99654d3ed7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:15.274875 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-2987aec0-7ce4-43fe-bb32-83db7ed4e8de req-699f00e4-3cc7-43f9-b8f5-1a99654d3ed7 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:15.286145 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-2987aec0-7ce4-43fe-bb32-83db7ed4e8de req-699f00e4-3cc7-43f9-b8f5-1a99654d3ed7 service nova] Creating event network-changed:560a2ae0-d66b-4604-b2a4-4879a9ad91a3 for instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d on hv-cinder-79760 Jul 04 08:08:15.291824 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-2987aec0-7ce4-43fe-bb32-83db7ed4e8de req-699f00e4-3cc7-43f9-b8f5-1a99654d3ed7 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031916 Jul 04 08:08:15.293208 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 311/645] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:08:17.381809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bc06208e-d7c3-444e-85fc-127743dcff3c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:17.382689 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bc06208e-d7c3-444e-85fc-127743dcff3c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:17.389198 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc06208e-d7c3-444e-85fc-127743dcff3c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:17.389693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc06208e-d7c3-444e-85fc-127743dcff3c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:17.390477 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc06208e-d7c3-444e-85fc-127743dcff3c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:17.390911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc06208e-d7c3-444e-85fc-127743dcff3c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:17.421838 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bc06208e-d7c3-444e-85fc-127743dcff3c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments/f1298696-9b1d-4604-8479-a50d0e03bda5" status: 200 len: 194 microversion: 2.20 time: 0.045501 Jul 04 08:08:17.424475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 335/646] 10.222.0.43 () {60 vars in 1453 bytes} [Mon Jul 4 08:08:17 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments/f1298696-9b1d-4604-8479-a50d0e03bda5 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 08:08:17.492644 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-be2cd5c7-b9bb-48b2-b7ed-f8860c9ee133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:17.493224 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-be2cd5c7-b9bb-48b2-b7ed-f8860c9ee133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:17.499808 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be2cd5c7-b9bb-48b2-b7ed-f8860c9ee133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:17.500247 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be2cd5c7-b9bb-48b2-b7ed-f8860c9ee133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:17.501037 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be2cd5c7-b9bb-48b2-b7ed-f8860c9ee133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:17.501464 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be2cd5c7-b9bb-48b2-b7ed-f8860c9ee133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:17.589675 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-be2cd5c7-b9bb-48b2-b7ed-f8860c9ee133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lazy-loading 'services' on Instance uuid a42c331b-8c2a-4f37-bd0a-7221b07bf3af {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:08:17.679148 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-be2cd5c7-b9bb-48b2-b7ed-f8860c9ee133 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments/f1298696-9b1d-4604-8479-a50d0e03bda5" status: 202 len: 0 microversion: 2.20 time: 0.190972 Jul 04 08:08:17.680478 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 312/647] 10.222.0.43 () {60 vars in 1456 bytes} [Mon Jul 4 08:08:17 2022] DELETE /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments/f1298696-9b1d-4604-8479-a50d0e03bda5 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:08:17.690699 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ad54e4f1-e85a-4cd3-bfba-b7773f2da203 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:17.691893 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ad54e4f1-e85a-4cd3-bfba-b7773f2da203 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:17.702634 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad54e4f1-e85a-4cd3-bfba-b7773f2da203 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:17.703404 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad54e4f1-e85a-4cd3-bfba-b7773f2da203 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:17.705099 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad54e4f1-e85a-4cd3-bfba-b7773f2da203 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:17.705781 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad54e4f1-e85a-4cd3-bfba-b7773f2da203 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:17.744893 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ad54e4f1-e85a-4cd3-bfba-b7773f2da203 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058956 Jul 04 08:08:17.745495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 336/648] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Jul 4 08:08:17 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 08:08:18.762193 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f6165f71-6eb8-459f-beb9-05c72ddddd81 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:18.763963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f6165f71-6eb8-459f-beb9-05c72ddddd81 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:18.774940 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6165f71-6eb8-459f-beb9-05c72ddddd81 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:18.775438 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6165f71-6eb8-459f-beb9-05c72ddddd81 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:18.776588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6165f71-6eb8-459f-beb9-05c72ddddd81 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:18.776991 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6165f71-6eb8-459f-beb9-05c72ddddd81 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:18.812591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f6165f71-6eb8-459f-beb9-05c72ddddd81 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059059 Jul 04 08:08:18.813168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 313/649] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Jul 4 08:08:18 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 08:08:19.825107 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cedc32a6-9fc0-4ef8-87b1-2c851edfa63e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:19.826303 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cedc32a6-9fc0-4ef8-87b1-2c851edfa63e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:19.833102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cedc32a6-9fc0-4ef8-87b1-2c851edfa63e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:19.833585 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cedc32a6-9fc0-4ef8-87b1-2c851edfa63e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:19.834368 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cedc32a6-9fc0-4ef8-87b1-2c851edfa63e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:19.834787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cedc32a6-9fc0-4ef8-87b1-2c851edfa63e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:19.868066 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cedc32a6-9fc0-4ef8-87b1-2c851edfa63e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047196 Jul 04 08:08:19.873765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 337/650] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Jul 4 08:08:19 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:19.929599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f7301b1e-80c5-4818-a6f7-429ef6640b2b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:19.930175 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f7301b1e-80c5-4818-a6f7-429ef6640b2b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:19.937045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f7301b1e-80c5-4818-a6f7-429ef6640b2b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:19.937444 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f7301b1e-80c5-4818-a6f7-429ef6640b2b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:19.938267 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f7301b1e-80c5-4818-a6f7-429ef6640b2b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:19.938761 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f7301b1e-80c5-4818-a6f7-429ef6640b2b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:19.943154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:19.970350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f7301b1e-80c5-4818-a6f7-429ef6640b2b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:08:20.053096 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f7301b1e-80c5-4818-a6f7-429ef6640b2b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 204 len: 0 microversion: 2.20 time: 0.127223 Jul 04 08:08:20.053789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 314/651] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Jul 4 08:08:19 2022] DELETE /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 08:08:20.062816 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:20.063330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:20.070097 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:20.070550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:20.071359 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:20.071833 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:20.240898 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:20.250931 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:20.253049 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:20.254269 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6d5e0977-bb8a-41db-80cd-48141259e676 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.195502 Jul 04 08:08:20.257667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 338/652] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:20 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:21.275689 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:21.276236 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:21.286049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:21.286626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:21.287668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:21.288298 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:21.444932 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:21.456397 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:21.458298 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:21.459644 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-99256ecd-89e4-475b-b0a5-104ccdd87153 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.190185 Jul 04 08:08:21.460274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 315/653] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:21 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:22.480503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:22.481113 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:22.488504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:22.488948 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:22.489753 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:22.490185 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:22.631034 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:22.640151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:22.641652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:22.643002 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e3324d6e-a169-4e5d-85d1-28af30743ab3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1725 microversion: 2.20 time: 0.167238 Jul 04 08:08:22.643567 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 339/654] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:22 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:23.193117 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-3a08de4a-8bd3-44b3-aa7c-f1e0536c91bf req-bb7eef73-86d6-485e-adb4-c8312657d52f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a42c331b-8c2a-4f37-bd0a-7221b07bf3af", "name": "network-vif-deleted", "tag": "624f3113-8fef-448f-b1f3-28db878c297b"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:23.202785 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3a08de4a-8bd3-44b3-aa7c-f1e0536c91bf req-bb7eef73-86d6-485e-adb4-c8312657d52f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:23.203112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3a08de4a-8bd3-44b3-aa7c-f1e0536c91bf req-bb7eef73-86d6-485e-adb4-c8312657d52f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:23.215797 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-3a08de4a-8bd3-44b3-aa7c-f1e0536c91bf req-bb7eef73-86d6-485e-adb4-c8312657d52f service nova] Creating event network-vif-deleted:624f3113-8fef-448f-b1f3-28db878c297b for instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af on hv-cinder-79760 Jul 04 08:08:23.222828 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-3a08de4a-8bd3-44b3-aa7c-f1e0536c91bf req-bb7eef73-86d6-485e-adb4-c8312657d52f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033498 Jul 04 08:08:23.223462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 316/655] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:08:23.664109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:23.664806 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:23.675206 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:23.675878 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:23.676779 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:23.677201 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:23.709654 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:23.710110 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:23.710548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lazy-loading 'fault' on Instance uuid a42c331b-8c2a-4f37-bd0a-7221b07bf3af {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:08:23.751887 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:23.760548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:23.761968 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:23.763111 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4476931b-32a8-4f20-9369-e2463636b695 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 200 len: 1371 microversion: 2.20 time: 0.103487 Jul 04 08:08:23.763657 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 340/656] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:23 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:24.783952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:24.784654 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:24.791547 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:24.792038 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:24.793008 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:24.793435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:24.811157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] HTTP exception thrown: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Request method failure captured: Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af HTTP/1.1 Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7kJk9qe9Y9rYx_iaxMq2EmAP7Gs8jeagCNXWtkwNNq5u0mV8VHqyQ_-FwVajKqoYjiJG3KS-B45QxckxMJkEH09OW0D1uJQ9bP2ZIoTOOANzdTG8WREkEZ9kFBrdC9IJ2O1nSBky6r2aXRngwD4SmNZkPUxD9YEJEz2qcWSIDrodc Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:08:24.812862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fadf5b15f7e43b4bd2372f22b293518", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 1501eb69e0a447ce83baa5bdee770d1f Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:08:24.814618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': 'a42c331b-8c2a-4f37-bd0a-7221b07bf3af'} Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:08:24.817539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:08:24.819051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:08:24.820392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Returning 404 to user: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:08:24.820392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5d43021c-9030-4cc5-9391-cf9b0eba8859 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 404 len: 111 microversion: 2.20 time: 0.035477 Jul 04 08:08:24.820392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 317/657] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:24 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:08:24.824030 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4878c751-72c6-4b16-9961-fd9d143c59dd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '.version_select at 0x7f05e55d39d0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:24.850210 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4878c751-72c6-4b16-9961-fd9d143c59dd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080070208" status: 204 len: 0 microversion: 2.20 time: 0.029730 Jul 04 08:08:24.851294 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 341/658] 10.222.0.43 () {60 vars in 1261 bytes} [Mon Jul 4 08:08:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1080070208 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 08:08:25.747648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-258fa966-2b97-4f4a-9a29-1cf94ab37fb4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'create', calling method: .version_select at 0x7f05e55ef670>, body: {"keypair": {"name": "tempest-keypair-1259868001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBv3TahPt8h1u3FIh/F2NFCraBnBIIcgXRyF5Sj6qCFokfkngi9b/IJaQTy/QYb08Rl+U5A5mqAC8DUlcltv13i2AKXwntTtD84+Lwyk9waZMPMxijiDnLgq2swEqXwm7w=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:25.762551 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-258fa966-2b97-4f4a-9a29-1cf94ab37fb4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Getting quotas for project 4fadf5b15f7e43b4bd2372f22b293518. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:08:25.766614 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-258fa966-2b97-4f4a-9a29-1cf94ab37fb4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Getting quotas for user 1501eb69e0a447ce83baa5bdee770d1f and project 4fadf5b15f7e43b4bd2372f22b293518. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:08:25.790698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-258fa966-2b97-4f4a-9a29-1cf94ab37fb4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047102 Jul 04 08:08:25.791419 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 318/659] 10.222.0.43 () {62 vars in 1199 bytes} [Mon Jul 4 08:08:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 04 08:08:27.206472 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1529279072", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6f1acad1-aa32-4b52-8575-cc350ac779f3"}], "security_groups": [{"name": "tempest-securitygroup--1287006437"}], "key_name": "tempest-keypair-1259868001", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:27.315105 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] validate_networks() for [('6f1acad1-aa32-4b52-8575-cc350ac779f3', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:08:27.718645 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:08:27.719060 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:08:27.719524 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:08:27.719929 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:08:27.720380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:08:27.729608 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:27.730091 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:27.730880 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:27.731332 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:27.749421 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Getting quotas for project 4fadf5b15f7e43b4bd2372f22b293518. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:08:27.753990 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Getting quotas for user 1501eb69e0a447ce83baa5bdee770d1f and project 4fadf5b15f7e43b4bd2372f22b293518. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:08:27.766174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:08:27.768499 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:08:27.823469 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d8ac42cb-150e-4f8c-9be1-188d25512fcd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.622017 Jul 04 08:08:27.824370 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 342/660] 10.222.0.43 () {62 vars in 1187 bytes} [Mon Jul 4 08:08:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 04 08:08:27.835157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e3288e2d-e01c-43cd-a7a3-ccb59343bd72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:27.835752 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e3288e2d-e01c-43cd-a7a3-ccb59343bd72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:28.066898 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e3288e2d-e01c-43cd-a7a3-ccb59343bd72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:28.074929 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e3288e2d-e01c-43cd-a7a3-ccb59343bd72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:28.076525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e3288e2d-e01c-43cd-a7a3-ccb59343bd72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:28.077899 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e3288e2d-e01c-43cd-a7a3-ccb59343bd72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1282 microversion: 2.20 time: 0.247197 Jul 04 08:08:28.078494 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 319/661] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:27 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1282 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:29.098320 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:29.098998 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:29.110215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:29.113108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:29.113108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:29.113108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:29.179609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:29.188895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:29.190671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:29.192027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-074992d6-7f6b-4049-be28-19d53d1bd5c3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1352 microversion: 2.20 time: 0.099503 Jul 04 08:08:29.192686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 343/662] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:29 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:30.211094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:30.211711 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:30.219036 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:30.219622 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:30.220587 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:30.221020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:30.544853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:30.553199 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:30.554755 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:30.555851 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-719e9ee5-ed29-4474-b215-89328f1380e5 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1408 microversion: 2.20 time: 0.348872 Jul 04 08:08:30.556405 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 320/663] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:30 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1408 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:31.086157 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-089dff17-f7e9-4f3a-a40a-5c1767995875 req-eb66686c-2a4b-472c-ba00-6d774e078c37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb350cf-6a02-4ede-be92-0a7863bc0475", "tag": "b71d89e6-8615-4c4e-8651-e32f4872be93"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:31.099108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-089dff17-f7e9-4f3a-a40a-5c1767995875 req-eb66686c-2a4b-472c-ba00-6d774e078c37 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:31.099547 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-089dff17-f7e9-4f3a-a40a-5c1767995875 req-eb66686c-2a4b-472c-ba00-6d774e078c37 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:31.113997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-089dff17-f7e9-4f3a-a40a-5c1767995875 req-eb66686c-2a4b-472c-ba00-6d774e078c37 service nova] Creating event network-changed:b71d89e6-8615-4c4e-8651-e32f4872be93 for instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 on hv-cinder-79760 Jul 04 08:08:31.121000 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-089dff17-f7e9-4f3a-a40a-5c1767995875 req-eb66686c-2a4b-472c-ba00-6d774e078c37 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040051 Jul 04 08:08:31.122572 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 344/664] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:08:31.574989 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:31.575709 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:31.583840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:31.584289 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:31.585144 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:31.585595 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:31.875853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:31.884530 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:31.886076 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:31.887198 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-27c5546a-2768-4cd4-9905-40b38f1c5e12 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1408 microversion: 2.20 time: 0.316331 Jul 04 08:08:31.887759 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 321/665] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:31 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1408 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:32.907382 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:32.908283 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:32.915254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:32.915722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:32.916481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:32.916913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:33.141734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:33.151080 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:33.152685 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:33.153840 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7e6a9965-0135-40b8-bcd2-367cd355bd39 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1408 microversion: 2.20 time: 0.251570 Jul 04 08:08:33.154410 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 345/666] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:32 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:34.172776 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:34.173767 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:34.181421 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:34.181893 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:34.182752 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:34.183216 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:34.325817 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:34.335960 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:34.337559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:34.338626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2573bf78-ba40-4914-9d02-f7a99118f7fe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1408 microversion: 2.20 time: 0.169924 Jul 04 08:08:34.339187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 322/667] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:34 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1408 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:35.363763 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:35.364379 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:35.371211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:35.371646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:35.372431 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:35.372863 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:35.518558 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:35.531228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:35.533315 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:35.534450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b16400de-acdd-4d3f-a9e6-7aac2a21d1a0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1408 microversion: 2.20 time: 0.176784 Jul 04 08:08:35.534982 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 346/668] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:35 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:36.553099 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:36.553709 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:36.560635 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:36.561081 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:36.561873 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:36.562302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:36.697859 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:36.709949 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:36.711466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:36.712582 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2ed372e2-3146-44b1-b3dc-ddde7c9a7827 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1408 microversion: 2.20 time: 0.163651 Jul 04 08:08:36.713189 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 323/669] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:36 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:37.730981 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:37.731586 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:37.737475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:37.739526 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:37.740061 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:37.741225 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:37.741225 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:37.744703 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-5e7327f8-f27c-44e2-af13-8892e7705786 req-fe08edf2-3295-459a-a2f6-b1be945d1e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb350cf-6a02-4ede-be92-0a7863bc0475", "name": "network-vif-plugged", "status": "completed", "tag": "b71d89e6-8615-4c4e-8651-e32f4872be93"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:37.753782 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-5e7327f8-f27c-44e2-af13-8892e7705786 req-fe08edf2-3295-459a-a2f6-b1be945d1e59 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:37.754249 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-5e7327f8-f27c-44e2-af13-8892e7705786 req-fe08edf2-3295-459a-a2f6-b1be945d1e59 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:37.764123 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:37.767165 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-5e7327f8-f27c-44e2-af13-8892e7705786 req-fe08edf2-3295-459a-a2f6-b1be945d1e59 service nova] Creating event network-vif-plugged:b71d89e6-8615-4c4e-8651-e32f4872be93 for instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 on hv-cinder-79760 Jul 04 08:08:37.772776 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-5e7327f8-f27c-44e2-af13-8892e7705786 req-fe08edf2-3295-459a-a2f6-b1be945d1e59 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032128 Jul 04 08:08:37.773590 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 324/670] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:08:37.890802 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:37.900121 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:37.901663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:37.902958 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-456baf28-04b8-435e-9f3b-cefa1ea98f5f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1408 microversion: 2.20 time: 0.175892 Jul 04 08:08:37.903533 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 347/671] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:37 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:38.920392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:38.926780 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:38.927478 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:38.934154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:38.934599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:38.935362 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:38.935789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:39.068280 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:39.076594 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:39.078147 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:39.079274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a82be2be-d4a7-4c28-8bde-1133638bc98f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1408 microversion: 2.20 time: 0.160665 Jul 04 08:08:39.079834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 325/672] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:38 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:40.100813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:40.101479 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:40.108520 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:40.108972 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:40.109750 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:40.110684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:40.210330 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-674e2795-5ccb-4559-907a-ef1ea77ca21a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17da7ad1-12a6-4f92-90e1-54767e6ada6a"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:40.211384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-674e2795-5ccb-4559-907a-ef1ea77ca21a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:40.217612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-674e2795-5ccb-4559-907a-ef1ea77ca21a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:40.218094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-674e2795-5ccb-4559-907a-ef1ea77ca21a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:40.218863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-674e2795-5ccb-4559-907a-ef1ea77ca21a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:40.219294 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-674e2795-5ccb-4559-907a-ef1ea77ca21a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:40.251504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:40.260568 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:40.262102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:40.263257 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9f236412-04d1-4a30-86a1-837a79156e83 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1601 microversion: 2.20 time: 0.168213 Jul 04 08:08:40.263814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 348/673] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:08:40 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:08:40.281077 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-272200d1-a697-42bc-9acb-aa099f83e2b2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:40.281543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-272200d1-a697-42bc-9acb-aa099f83e2b2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:40.288124 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-272200d1-a697-42bc-9acb-aa099f83e2b2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:40.288563 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-272200d1-a697-42bc-9acb-aa099f83e2b2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:40.289312 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-272200d1-a697-42bc-9acb-aa099f83e2b2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:40.289774 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-272200d1-a697-42bc-9acb-aa099f83e2b2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:40.369491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-272200d1-a697-42bc-9acb-aa099f83e2b2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092322 Jul 04 08:08:40.370170 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 349/674] 10.222.0.43 () {60 vars in 1315 bytes} [Mon Jul 4 08:08:40 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 08:08:40.497354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-674e2795-5ccb-4559-907a-ef1ea77ca21a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291565 Jul 04 08:08:40.498274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 326/675] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:08:40 2022] POST /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:08:41.349595 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-1d0f42d7-bf36-4ce0-aae9-685eb169dda5 req-c07c1e77-6afe-4c8e-8a7b-0ef23c6e27c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb350cf-6a02-4ede-be92-0a7863bc0475", "tag": "b71d89e6-8615-4c4e-8651-e32f4872be93"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:41.359903 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1d0f42d7-bf36-4ce0-aae9-685eb169dda5 req-c07c1e77-6afe-4c8e-8a7b-0ef23c6e27c0 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:41.360343 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1d0f42d7-bf36-4ce0-aae9-685eb169dda5 req-c07c1e77-6afe-4c8e-8a7b-0ef23c6e27c0 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:41.374659 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-1d0f42d7-bf36-4ce0-aae9-685eb169dda5 req-c07c1e77-6afe-4c8e-8a7b-0ef23c6e27c0 service nova] Creating event network-changed:b71d89e6-8615-4c4e-8651-e32f4872be93 for instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 on hv-cinder-79760 Jul 04 08:08:41.381231 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-1d0f42d7-bf36-4ce0-aae9-685eb169dda5 req-c07c1e77-6afe-4c8e-8a7b-0ef23c6e27c0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036387 Jul 04 08:08:41.381954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 350/676] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:08:46.896206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-60fe0e4e-6e7d-426e-8a83-15731dc9c3f9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:46.897446 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-60fe0e4e-6e7d-426e-8a83-15731dc9c3f9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:46.901390 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:46.905543 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-60fe0e4e-6e7d-426e-8a83-15731dc9c3f9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:46.906320 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-60fe0e4e-6e7d-426e-8a83-15731dc9c3f9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:46.907020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-60fe0e4e-6e7d-426e-8a83-15731dc9c3f9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:46.907517 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-60fe0e4e-6e7d-426e-8a83-15731dc9c3f9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:46.940659 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-60fe0e4e-6e7d-426e-8a83-15731dc9c3f9 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049354 Jul 04 08:08:46.941221 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 327/677] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:08:46 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 08:08:47.002145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b43717a4-715b-4c5a-bffd-b2bce6a99c02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:47.003072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b43717a4-715b-4c5a-bffd-b2bce6a99c02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:47.005952 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:47.012218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b43717a4-715b-4c5a-bffd-b2bce6a99c02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:47.012646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b43717a4-715b-4c5a-bffd-b2bce6a99c02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:47.013407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b43717a4-715b-4c5a-bffd-b2bce6a99c02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:47.013859 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b43717a4-715b-4c5a-bffd-b2bce6a99c02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:47.016884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=87 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:47.044664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b43717a4-715b-4c5a-bffd-b2bce6a99c02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:08:47.138914 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b43717a4-715b-4c5a-bffd-b2bce6a99c02 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 204 len: 0 microversion: 2.1 time: 0.144276 Jul 04 08:08:47.139505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 351/678] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:08:46 2022] DELETE /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:08:47.148242 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a4e80be4-f812-41b3-9276-eac33f11c442 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:47.148917 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a4e80be4-f812-41b3-9276-eac33f11c442 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:47.156029 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4e80be4-f812-41b3-9276-eac33f11c442 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:47.156466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4e80be4-f812-41b3-9276-eac33f11c442 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:47.157220 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4e80be4-f812-41b3-9276-eac33f11c442 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:47.157672 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a4e80be4-f812-41b3-9276-eac33f11c442 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:47.300155 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a4e80be4-f812-41b3-9276-eac33f11c442 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:47.308462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a4e80be4-f812-41b3-9276-eac33f11c442 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1673 microversion: 2.1 time: 0.164098 Jul 04 08:08:47.309140 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 328/679] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:47 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:08:48.326982 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bc925161-2243-4ffd-8e65-e6c99df6ec11 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:48.327697 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bc925161-2243-4ffd-8e65-e6c99df6ec11 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:48.334856 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc925161-2243-4ffd-8e65-e6c99df6ec11 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:48.335299 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc925161-2243-4ffd-8e65-e6c99df6ec11 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:48.336067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc925161-2243-4ffd-8e65-e6c99df6ec11 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:48.336491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc925161-2243-4ffd-8e65-e6c99df6ec11 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:48.475126 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bc925161-2243-4ffd-8e65-e6c99df6ec11 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:48.483320 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bc925161-2243-4ffd-8e65-e6c99df6ec11 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1673 microversion: 2.1 time: 0.160629 Jul 04 08:08:48.483902 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 352/680] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:48 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:49.505664 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-230dba99-a5d1-4bc8-acd7-fc0665d71428 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:49.506617 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-230dba99-a5d1-4bc8-acd7-fc0665d71428 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:49.514441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230dba99-a5d1-4bc8-acd7-fc0665d71428 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:49.514892 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230dba99-a5d1-4bc8-acd7-fc0665d71428 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:49.515641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230dba99-a5d1-4bc8-acd7-fc0665d71428 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:49.516106 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230dba99-a5d1-4bc8-acd7-fc0665d71428 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:49.751330 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-230dba99-a5d1-4bc8-acd7-fc0665d71428 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:49.759583 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-230dba99-a5d1-4bc8-acd7-fc0665d71428 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1673 microversion: 2.1 time: 0.260481 Jul 04 08:08:49.760721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 329/681] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:49 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1673 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:50.187575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-07fde97e-e1e8-4939-8012-c1fee06e1d8b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:50.188744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-07fde97e-e1e8-4939-8012-c1fee06e1d8b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:50.195948 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07fde97e-e1e8-4939-8012-c1fee06e1d8b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:50.196654 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07fde97e-e1e8-4939-8012-c1fee06e1d8b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:50.197408 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07fde97e-e1e8-4939-8012-c1fee06e1d8b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:50.198504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07fde97e-e1e8-4939-8012-c1fee06e1d8b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:50.238650 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-07fde97e-e1e8-4939-8012-c1fee06e1d8b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'flavor' on Instance uuid 3ab500b1-c48b-483c-978c-c34e45412a3a {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:08:50.372778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-07fde97e-e1e8-4939-8012-c1fee06e1d8b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/action" status: 200 len: 32 microversion: 2.1 time: 0.189115 Jul 04 08:08:50.373534 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 353/682] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:08:50 2022] POST /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 08:08:50.384969 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d8ebdbb8-7ff9-4dac-a7df-1ac3abbac2f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:50.385221 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d8ebdbb8-7ff9-4dac-a7df-1ac3abbac2f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:50.391783 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d8ebdbb8-7ff9-4dac-a7df-1ac3abbac2f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:50.392477 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d8ebdbb8-7ff9-4dac-a7df-1ac3abbac2f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:50.393403 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d8ebdbb8-7ff9-4dac-a7df-1ac3abbac2f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:50.394205 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d8ebdbb8-7ff9-4dac-a7df-1ac3abbac2f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:50.398815 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:08:50.575981 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-6acd8d79-012b-4ab6-96f3-03240704a73d req-59275580-8ca1-48bc-a55e-54fbf9c306f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b415c8c-45f0-4469-82d4-a3b8c3c6145f", "name": "network-vif-deleted", "tag": "84fb4212-970a-48e7-a1ab-238bd3c64f6a"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:50.587256 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-6acd8d79-012b-4ab6-96f3-03240704a73d req-59275580-8ca1-48bc-a55e-54fbf9c306f3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:50.587749 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-6acd8d79-012b-4ab6-96f3-03240704a73d req-59275580-8ca1-48bc-a55e-54fbf9c306f3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:50.605667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-6acd8d79-012b-4ab6-96f3-03240704a73d req-59275580-8ca1-48bc-a55e-54fbf9c306f3 service nova] Creating event network-vif-deleted:84fb4212-970a-48e7-a1ab-238bd3c64f6a for instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f on hv-cinder-79760 Jul 04 08:08:50.611521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-6acd8d79-012b-4ab6-96f3-03240704a73d req-59275580-8ca1-48bc-a55e-54fbf9c306f3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045355 Jul 04 08:08:50.612820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 354/683] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:08:50.778242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:50.778942 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:50.786220 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:50.786571 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:50.787569 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:50.788028 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:50.826235 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:50.826696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:50.827171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lazy-loading 'fault' on Instance uuid 3b415c8c-45f0-4469-82d4-a3b8c3c6145f {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:08:50.885287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:50.894777 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1ecf2214-d496-4f93-8e3f-3f74a555d666 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 200 len: 1326 microversion: 2.1 time: 0.121304 Jul 04 08:08:50.895700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 355/684] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:50 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 1326 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:51.014251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d8ebdbb8-7ff9-4dac-a7df-1ac3abbac2f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:51.033660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d8ebdbb8-7ff9-4dac-a7df-1ac3abbac2f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.654294 Jul 04 08:08:51.034303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 330/685] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:50 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:08:51.913768 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:51.914346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:51.921513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:51.921990 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:51.922780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:51.923202 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:51.938117 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] HTTP exception thrown: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Request method failure captured: Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f HTTP/1.1 Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7c93-U7Fc6zr2rEoMiT6zeB6n68PvZs_1ezjOBvg6I68sX2bGuy1_lQ6R_JrLmxEOoN1ACL2peE-9FNMBuTEmEBqBMAQr_KWXr3oweCf4HxEYrMOK5gIqUL8f28w8rEQ7HOJofDQrDVs1ReKgwEbN0kSNniI8rFI8frRKTQpVlMrI Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:08:51.939814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34a4b394ba684ed2a67d14b4a5b24f2f", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 18b1072539af49729dff7ee9ea445c77 Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:08:51.944205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '3b415c8c-45f0-4469-82d4-a3b8c3c6145f'} Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:08:51.945326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:08:51.947017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:08:51.948373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Returning 404 to user: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:08:51.948373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2da047af-77ad-4e5d-8f29-079fe89d07dc tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 404 len: 111 microversion: 2.1 time: 0.031586 Jul 04 08:08:51.948373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 356/686] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:51 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:08:51.950682 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-be181d26-cf2c-4d38-98aa-2257395e593d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '.version_select at 0x7f05e55e5ee0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:51.971551 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-be181d26-cf2c-4d38-98aa-2257395e593d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-764593724" status: 202 len: 0 microversion: 2.1 time: 0.024911 Jul 04 08:08:51.972173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 331/687] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jul 4 08:08:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-764593724 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:08:52.051397 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5d74e5cb-021a-4eae-9483-f3d6f58d10b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:52.052250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5d74e5cb-021a-4eae-9483-f3d6f58d10b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:52.058904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d74e5cb-021a-4eae-9483-f3d6f58d10b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:52.059349 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d74e5cb-021a-4eae-9483-f3d6f58d10b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:52.060182 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d74e5cb-021a-4eae-9483-f3d6f58d10b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:52.060564 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d74e5cb-021a-4eae-9483-f3d6f58d10b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:52.305799 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5d74e5cb-021a-4eae-9483-f3d6f58d10b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:52.315424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5d74e5cb-021a-4eae-9483-f3d6f58d10b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.267792 Jul 04 08:08:52.316262 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 357/688] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:52 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:52.734011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d48fc133-1823-4587-9a57-401f9c2afb83 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'create', calling method: .version_select at 0x7f05e56329d0>, body: {"keypair": {"name": "tempest-keypair-1363695053", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+ORXf5mxVT62gifS9aNssjSunX1l7Zp3+NZOIqdBLFuxa3EY67MWBzZErHXBpdpqRSBP3xSECsmOR4pkEXNx6pUxnPu1ms4CXB4FvqI+xr4fKedBre8MqKqDv04z9vuQ=="}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:52.751473 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-d48fc133-1823-4587-9a57-401f9c2afb83 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Getting quotas for project 34a4b394ba684ed2a67d14b4a5b24f2f. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:08:52.756044 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-d48fc133-1823-4587-9a57-401f9c2afb83 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Getting quotas for user 18b1072539af49729dff7ee9ea445c77 and project 34a4b394ba684ed2a67d14b4a5b24f2f. Resources: {'key_pairs'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:08:52.781908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d48fc133-1823-4587-9a57-401f9c2afb83 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054434 Jul 04 08:08:52.782528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 332/689] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:08:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:08:53.341733 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e77fa030-fcb7-4f10-9f42-453b4f124ed1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:53.342473 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e77fa030-fcb7-4f10-9f42-453b4f124ed1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:53.349242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e77fa030-fcb7-4f10-9f42-453b4f124ed1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:53.349782 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e77fa030-fcb7-4f10-9f42-453b4f124ed1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:53.350679 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e77fa030-fcb7-4f10-9f42-453b4f124ed1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:53.351097 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e77fa030-fcb7-4f10-9f42-453b4f124ed1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:53.580882 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e77fa030-fcb7-4f10-9f42-453b4f124ed1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:53.590466 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e77fa030-fcb7-4f10-9f42-453b4f124ed1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.252629 Jul 04 08:08:53.591151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 358/690] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:53 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:54.458317 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-300971776", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "094c34d1-ba24-4fc3-9ee2-cebe30c3a997"}], "security_groups": [{"name": "tempest-securitygroup--758263485"}], "key_name": "tempest-keypair-1363695053", "user_data": "}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:54.571190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] validate_networks() for [('094c34d1-ba24-4fc3-9ee2-cebe30c3a997', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:08:54.610345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a66ee525-b28e-4a29-b94e-c94cedf0cfb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:54.611372 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a66ee525-b28e-4a29-b94e-c94cedf0cfb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:54.620252 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a66ee525-b28e-4a29-b94e-c94cedf0cfb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:54.621020 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a66ee525-b28e-4a29-b94e-c94cedf0cfb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:54.621979 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a66ee525-b28e-4a29-b94e-c94cedf0cfb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:54.622694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a66ee525-b28e-4a29-b94e-c94cedf0cfb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:54.768302 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a66ee525-b28e-4a29-b94e-c94cedf0cfb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:54.777723 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a66ee525-b28e-4a29-b94e-c94cedf0cfb8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.172556 Jul 04 08:08:54.778303 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 359/691] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:54 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:55.047375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:08:55.047813 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:08:55.048312 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:08:55.048738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:08:55.049135 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:08:55.059086 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:55.059528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:55.060325 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:55.060738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:55.079053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Getting quotas for project 34a4b394ba684ed2a67d14b4a5b24f2f. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:08:55.083310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Getting quotas for user 18b1072539af49729dff7ee9ea445c77 and project 34a4b394ba684ed2a67d14b4a5b24f2f. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:08:55.094822 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:08:55.097085 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:08:55.148076 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2f997a88-353e-4314-a758-02ecb2fa1b2d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694116 Jul 04 08:08:55.148637 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 333/692] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:08:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:08:55.158875 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2fc717e2-893c-41c0-b672-afe1a45a0914 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:55.159484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2fc717e2-893c-41c0-b672-afe1a45a0914 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:55.225120 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2fc717e2-893c-41c0-b672-afe1a45a0914 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:55.232543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2fc717e2-893c-41c0-b672-afe1a45a0914 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1237 microversion: 2.1 time: 0.077526 Jul 04 08:08:55.233259 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 360/693] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:55 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:55.796451 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6dab0ddc-bbdb-4018-97ed-1062856379ed tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:55.797042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6dab0ddc-bbdb-4018-97ed-1062856379ed tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:55.803755 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6dab0ddc-bbdb-4018-97ed-1062856379ed tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:55.804463 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6dab0ddc-bbdb-4018-97ed-1062856379ed tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:55.805538 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6dab0ddc-bbdb-4018-97ed-1062856379ed tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:55.806392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6dab0ddc-bbdb-4018-97ed-1062856379ed tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:55.956201 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6dab0ddc-bbdb-4018-97ed-1062856379ed tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:55.966436 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6dab0ddc-bbdb-4018-97ed-1062856379ed tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.174451 Jul 04 08:08:55.967003 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 334/694] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:55 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:56.251838 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ad863dae-51e7-4cc9-b9fc-c011ef956543 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:56.252939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ad863dae-51e7-4cc9-b9fc-c011ef956543 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:56.259947 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad863dae-51e7-4cc9-b9fc-c011ef956543 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:56.260382 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad863dae-51e7-4cc9-b9fc-c011ef956543 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:56.261176 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad863dae-51e7-4cc9-b9fc-c011ef956543 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:56.261610 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad863dae-51e7-4cc9-b9fc-c011ef956543 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:56.326102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ad863dae-51e7-4cc9-b9fc-c011ef956543 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:56.337058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ad863dae-51e7-4cc9-b9fc-c011ef956543 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1289 microversion: 2.1 time: 0.089131 Jul 04 08:08:56.338765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 361/695] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:56 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:56.986499 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-09d8f12b-e39a-4d1c-a9a2-ebae826a1bd8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:56.987118 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-09d8f12b-e39a-4d1c-a9a2-ebae826a1bd8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:56.995761 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09d8f12b-e39a-4d1c-a9a2-ebae826a1bd8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:56.996212 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09d8f12b-e39a-4d1c-a9a2-ebae826a1bd8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:56.997005 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09d8f12b-e39a-4d1c-a9a2-ebae826a1bd8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:56.997435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09d8f12b-e39a-4d1c-a9a2-ebae826a1bd8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:57.243854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-09d8f12b-e39a-4d1c-a9a2-ebae826a1bd8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:57.253147 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-09d8f12b-e39a-4d1c-a9a2-ebae826a1bd8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.271502 Jul 04 08:08:57.253900 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 335/696] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:56 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:57.361513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bcc675e4-097d-4a89-bfa8-a781e5ecf738 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:57.362342 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bcc675e4-097d-4a89-bfa8-a781e5ecf738 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:57.369674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bcc675e4-097d-4a89-bfa8-a781e5ecf738 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:57.370220 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bcc675e4-097d-4a89-bfa8-a781e5ecf738 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:57.371669 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bcc675e4-097d-4a89-bfa8-a781e5ecf738 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:57.371669 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bcc675e4-097d-4a89-bfa8-a781e5ecf738 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:57.515822 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bcc675e4-097d-4a89-bfa8-a781e5ecf738 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:57.524463 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bcc675e4-097d-4a89-bfa8-a781e5ecf738 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1362 microversion: 2.1 time: 0.167476 Jul 04 08:08:57.525708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 362/697] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:57 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:58.090123 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-b545f068-379c-472d-8812-a54d7bcd7544 req-aa24c308-cc03-4890-8d47-bc02f4857d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbad2f2-0053-4c22-a052-48d2265b2c6c", "tag": "86e0ac73-22b7-4a2b-b97c-c96f71ac308a"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:08:58.100126 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b545f068-379c-472d-8812-a54d7bcd7544 req-aa24c308-cc03-4890-8d47-bc02f4857d90 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:58.100877 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b545f068-379c-472d-8812-a54d7bcd7544 req-aa24c308-cc03-4890-8d47-bc02f4857d90 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:58.115550 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-b545f068-379c-472d-8812-a54d7bcd7544 req-aa24c308-cc03-4890-8d47-bc02f4857d90 service nova] Creating event network-changed:86e0ac73-22b7-4a2b-b97c-c96f71ac308a for instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c on hv-cinder-79760 Jul 04 08:08:58.123768 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-b545f068-379c-472d-8812-a54d7bcd7544 req-aa24c308-cc03-4890-8d47-bc02f4857d90 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037401 Jul 04 08:08:58.124573 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 336/698] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:08:58.271636 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-061db26e-12a2-405a-9e51-6dbf48728aac tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:58.272266 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-061db26e-12a2-405a-9e51-6dbf48728aac tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:58.280301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-061db26e-12a2-405a-9e51-6dbf48728aac tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:58.280735 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-061db26e-12a2-405a-9e51-6dbf48728aac tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:58.281502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-061db26e-12a2-405a-9e51-6dbf48728aac tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:58.281967 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-061db26e-12a2-405a-9e51-6dbf48728aac tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:58.424067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-061db26e-12a2-405a-9e51-6dbf48728aac tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:58.432646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-061db26e-12a2-405a-9e51-6dbf48728aac tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.164870 Jul 04 08:08:58.433333 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 363/699] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:58 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:58.542803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fdf7ca3d-8f26-4e63-a96e-abb799cc7775 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:58.543570 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fdf7ca3d-8f26-4e63-a96e-abb799cc7775 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:58.550206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fdf7ca3d-8f26-4e63-a96e-abb799cc7775 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:58.550656 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fdf7ca3d-8f26-4e63-a96e-abb799cc7775 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:58.551446 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fdf7ca3d-8f26-4e63-a96e-abb799cc7775 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:58.551857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fdf7ca3d-8f26-4e63-a96e-abb799cc7775 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:58.751648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fdf7ca3d-8f26-4e63-a96e-abb799cc7775 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:58.760743 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fdf7ca3d-8f26-4e63-a96e-abb799cc7775 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1362 microversion: 2.1 time: 0.222442 Jul 04 08:08:58.761330 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 337/700] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:58 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1362 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:08:59.451241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c9c00e56-873a-4764-b97d-b044a50f6866 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:59.451845 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c9c00e56-873a-4764-b97d-b044a50f6866 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:59.459153 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9c00e56-873a-4764-b97d-b044a50f6866 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:59.459598 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9c00e56-873a-4764-b97d-b044a50f6866 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:59.460386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9c00e56-873a-4764-b97d-b044a50f6866 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:59.460817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9c00e56-873a-4764-b97d-b044a50f6866 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:59.606325 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c9c00e56-873a-4764-b97d-b044a50f6866 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:59.618373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c9c00e56-873a-4764-b97d-b044a50f6866 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.171109 Jul 04 08:08:59.619666 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 364/701] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:59 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:08:59.778632 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-754a0e42-2172-4596-8d6f-d98bd4cfa850 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:08:59.779233 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-754a0e42-2172-4596-8d6f-d98bd4cfa850 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:08:59.786491 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-754a0e42-2172-4596-8d6f-d98bd4cfa850 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:59.786975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-754a0e42-2172-4596-8d6f-d98bd4cfa850 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:59.787745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-754a0e42-2172-4596-8d6f-d98bd4cfa850 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:08:59.788177 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-754a0e42-2172-4596-8d6f-d98bd4cfa850 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:08:59.941245 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-754a0e42-2172-4596-8d6f-d98bd4cfa850 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:08:59.949931 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-754a0e42-2172-4596-8d6f-d98bd4cfa850 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1362 microversion: 2.1 time: 0.175565 Jul 04 08:08:59.950500 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 338/702] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:08:59 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:00.644194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7599bd96-2a5a-4c26-9a2a-efd3e029c329 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:00.644801 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7599bd96-2a5a-4c26-9a2a-efd3e029c329 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:00.653794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7599bd96-2a5a-4c26-9a2a-efd3e029c329 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:00.654270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7599bd96-2a5a-4c26-9a2a-efd3e029c329 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:00.655045 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7599bd96-2a5a-4c26-9a2a-efd3e029c329 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:00.655466 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7599bd96-2a5a-4c26-9a2a-efd3e029c329 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:00.799455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7599bd96-2a5a-4c26-9a2a-efd3e029c329 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:00.808530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7599bd96-2a5a-4c26-9a2a-efd3e029c329 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.169455 Jul 04 08:09:00.809117 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 365/703] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:00 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:00.970993 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e6a7647b-8ce1-47b6-b3a2-cc7d6e67bf6d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:00.971599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e6a7647b-8ce1-47b6-b3a2-cc7d6e67bf6d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:00.983770 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e6a7647b-8ce1-47b6-b3a2-cc7d6e67bf6d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:00.983770 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e6a7647b-8ce1-47b6-b3a2-cc7d6e67bf6d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:00.984658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e6a7647b-8ce1-47b6-b3a2-cc7d6e67bf6d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:00.985091 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e6a7647b-8ce1-47b6-b3a2-cc7d6e67bf6d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:01.128924 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e6a7647b-8ce1-47b6-b3a2-cc7d6e67bf6d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:01.137478 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e6a7647b-8ce1-47b6-b3a2-cc7d6e67bf6d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1362 microversion: 2.1 time: 0.170429 Jul 04 08:09:01.138112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 339/704] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:00 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:09:01.827041 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-254f52f2-80fe-40dd-b75a-ef0584e79a3d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:01.827634 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-254f52f2-80fe-40dd-b75a-ef0584e79a3d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:01.834720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-254f52f2-80fe-40dd-b75a-ef0584e79a3d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:01.835167 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-254f52f2-80fe-40dd-b75a-ef0584e79a3d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:01.835933 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-254f52f2-80fe-40dd-b75a-ef0584e79a3d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:01.836358 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-254f52f2-80fe-40dd-b75a-ef0584e79a3d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:01.841851 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:01.987072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-254f52f2-80fe-40dd-b75a-ef0584e79a3d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:01.996657 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-254f52f2-80fe-40dd-b75a-ef0584e79a3d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.173814 Jul 04 08:09:01.997260 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 366/705] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:01 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:02.156464 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d63427c0-e61f-4256-83fa-d4f3647ec790 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:02.157091 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d63427c0-e61f-4256-83fa-d4f3647ec790 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:02.164064 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d63427c0-e61f-4256-83fa-d4f3647ec790 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:02.164537 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d63427c0-e61f-4256-83fa-d4f3647ec790 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:02.165305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d63427c0-e61f-4256-83fa-d4f3647ec790 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:02.165772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d63427c0-e61f-4256-83fa-d4f3647ec790 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:02.313274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d63427c0-e61f-4256-83fa-d4f3647ec790 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:02.321066 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d63427c0-e61f-4256-83fa-d4f3647ec790 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1362 microversion: 2.1 time: 0.168595 Jul 04 08:09:02.321687 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 340/706] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:02 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:02.873774 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-af0c5dcd-918f-4d55-adbe-f61c2fe682b9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:02.874378 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-af0c5dcd-918f-4d55-adbe-f61c2fe682b9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:02.883570 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af0c5dcd-918f-4d55-adbe-f61c2fe682b9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:02.884216 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af0c5dcd-918f-4d55-adbe-f61c2fe682b9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:02.885386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af0c5dcd-918f-4d55-adbe-f61c2fe682b9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:02.885984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af0c5dcd-918f-4d55-adbe-f61c2fe682b9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:02.915650 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-af0c5dcd-918f-4d55-adbe-f61c2fe682b9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/ips" status: 200 len: 149 microversion: 2.1 time: 0.176904 Jul 04 08:09:02.916212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 367/707] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:09:02 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/ips => generated 149 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:03.020944 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c5838109-2de4-4f6b-bc03-3f1054be0be5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:03.021924 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c5838109-2de4-4f6b-bc03-3f1054be0be5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:03.032973 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c5838109-2de4-4f6b-bc03-3f1054be0be5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:03.032973 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c5838109-2de4-4f6b-bc03-3f1054be0be5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:03.033444 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c5838109-2de4-4f6b-bc03-3f1054be0be5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:03.040649 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c5838109-2de4-4f6b-bc03-3f1054be0be5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:03.220503 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c5838109-2de4-4f6b-bc03-3f1054be0be5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:03.230665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c5838109-2de4-4f6b-bc03-3f1054be0be5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.213768 Jul 04 08:09:03.240507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 341/708] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:03 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:03.340221 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a172a3c6-c8f1-425d-bde3-fc7e57a7cf38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:03.340889 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a172a3c6-c8f1-425d-bde3-fc7e57a7cf38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:03.349419 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a172a3c6-c8f1-425d-bde3-fc7e57a7cf38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:03.350128 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a172a3c6-c8f1-425d-bde3-fc7e57a7cf38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:03.351251 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a172a3c6-c8f1-425d-bde3-fc7e57a7cf38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:03.351891 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a172a3c6-c8f1-425d-bde3-fc7e57a7cf38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:03.495718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a172a3c6-c8f1-425d-bde3-fc7e57a7cf38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:03.503780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a172a3c6-c8f1-425d-bde3-fc7e57a7cf38 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1362 microversion: 2.1 time: 0.169967 Jul 04 08:09:03.504348 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 368/709] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:03 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:03.855104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-f4193e51-c47b-4acf-94cb-25e7cd6719bc req-681ba68f-adf0-417b-a0e9-1fe1e21210ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbad2f2-0053-4c22-a052-48d2265b2c6c", "name": "network-vif-plugged", "status": "completed", "tag": "86e0ac73-22b7-4a2b-b97c-c96f71ac308a"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:03.864312 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f4193e51-c47b-4acf-94cb-25e7cd6719bc req-681ba68f-adf0-417b-a0e9-1fe1e21210ef service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:03.864829 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f4193e51-c47b-4acf-94cb-25e7cd6719bc req-681ba68f-adf0-417b-a0e9-1fe1e21210ef service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:03.876791 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-f4193e51-c47b-4acf-94cb-25e7cd6719bc req-681ba68f-adf0-417b-a0e9-1fe1e21210ef service nova] Creating event network-vif-plugged:86e0ac73-22b7-4a2b-b97c-c96f71ac308a for instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c on hv-cinder-79760 Jul 04 08:09:03.882404 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-f4193e51-c47b-4acf-94cb-25e7cd6719bc req-681ba68f-adf0-417b-a0e9-1fe1e21210ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031120 Jul 04 08:09:03.883227 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 342/710] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:04.247908 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-96fc4b46-2123-4502-896a-8f88afb846f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:04.248472 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-96fc4b46-2123-4502-896a-8f88afb846f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:04.255997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-96fc4b46-2123-4502-896a-8f88afb846f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:04.256441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-96fc4b46-2123-4502-896a-8f88afb846f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:04.257238 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-96fc4b46-2123-4502-896a-8f88afb846f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:04.258203 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-96fc4b46-2123-4502-896a-8f88afb846f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:04.317868 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-71b1854e-94d3-407a-adfa-f3a4e51a8335 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2ba0981-1b1f-4ff0-9a94-b80406b270c3"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:04.319006 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-71b1854e-94d3-407a-adfa-f3a4e51a8335 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:04.326391 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71b1854e-94d3-407a-adfa-f3a4e51a8335 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:04.326831 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71b1854e-94d3-407a-adfa-f3a4e51a8335 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:04.327593 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71b1854e-94d3-407a-adfa-f3a4e51a8335 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:04.328022 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-71b1854e-94d3-407a-adfa-f3a4e51a8335 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:04.399926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-96fc4b46-2123-4502-896a-8f88afb846f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:04.408700 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-96fc4b46-2123-4502-896a-8f88afb846f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.164840 Jul 04 08:09:04.409288 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 369/711] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:04 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:04.523135 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-30aa6708-9bf1-400d-a7af-6c1e2a664f50 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:04.523868 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-30aa6708-9bf1-400d-a7af-6c1e2a664f50 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:04.532346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-30aa6708-9bf1-400d-a7af-6c1e2a664f50 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:04.532778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-30aa6708-9bf1-400d-a7af-6c1e2a664f50 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:04.533612 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-30aa6708-9bf1-400d-a7af-6c1e2a664f50 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:04.534108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-30aa6708-9bf1-400d-a7af-6c1e2a664f50 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:04.676190 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-30aa6708-9bf1-400d-a7af-6c1e2a664f50 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:04.684178 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-30aa6708-9bf1-400d-a7af-6c1e2a664f50 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1362 microversion: 2.1 time: 0.166898 Jul 04 08:09:04.684907 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 370/712] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:04 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:05.068777 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:05.090496 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=10 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:05.179132 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-71b1854e-94d3-407a-adfa-f3a4e51a8335 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.865416 Jul 04 08:09:05.180249 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 343/713] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:09:04 2022] POST /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:05.428683 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c86ca8ca-bed3-40c5-83fb-4321d815d983 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:05.429319 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c86ca8ca-bed3-40c5-83fb-4321d815d983 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:05.431228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:05.437923 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c86ca8ca-bed3-40c5-83fb-4321d815d983 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:05.438366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c86ca8ca-bed3-40c5-83fb-4321d815d983 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:05.439138 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c86ca8ca-bed3-40c5-83fb-4321d815d983 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:05.439571 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c86ca8ca-bed3-40c5-83fb-4321d815d983 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:05.582675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c86ca8ca-bed3-40c5-83fb-4321d815d983 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:05.590926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c86ca8ca-bed3-40c5-83fb-4321d815d983 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.167994 Jul 04 08:09:05.591513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 371/714] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:05 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:05.701806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d2de9189-c398-4400-ade6-e9975c43bc59 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:05.702706 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d2de9189-c398-4400-ade6-e9975c43bc59 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:05.710021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2de9189-c398-4400-ade6-e9975c43bc59 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:05.710492 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2de9189-c398-4400-ade6-e9975c43bc59 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:05.711352 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2de9189-c398-4400-ade6-e9975c43bc59 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:05.711815 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d2de9189-c398-4400-ade6-e9975c43bc59 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:05.857664 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d2de9189-c398-4400-ade6-e9975c43bc59 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:05.868769 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d2de9189-c398-4400-ade6-e9975c43bc59 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1362 microversion: 2.1 time: 0.171793 Jul 04 08:09:05.869356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 344/715] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:05 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:06.609577 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e7fb0f43-2e37-4f5a-bae4-e85aa933e6c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:06.610208 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e7fb0f43-2e37-4f5a-bae4-e85aa933e6c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:06.616961 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7fb0f43-2e37-4f5a-bae4-e85aa933e6c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:06.617393 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7fb0f43-2e37-4f5a-bae4-e85aa933e6c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:06.618191 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7fb0f43-2e37-4f5a-bae4-e85aa933e6c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:06.618640 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7fb0f43-2e37-4f5a-bae4-e85aa933e6c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:06.762517 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e7fb0f43-2e37-4f5a-bae4-e85aa933e6c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:06.770913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e7fb0f43-2e37-4f5a-bae4-e85aa933e6c9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.165877 Jul 04 08:09:06.771608 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 372/716] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:06 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:06.887569 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5f58594e-1a16-43b0-8b98-f40d97e35823 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:06.888183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5f58594e-1a16-43b0-8b98-f40d97e35823 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:06.895491 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f58594e-1a16-43b0-8b98-f40d97e35823 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:06.895943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f58594e-1a16-43b0-8b98-f40d97e35823 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:06.896718 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f58594e-1a16-43b0-8b98-f40d97e35823 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:06.897144 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5f58594e-1a16-43b0-8b98-f40d97e35823 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:07.052699 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5f58594e-1a16-43b0-8b98-f40d97e35823 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:07.060841 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5f58594e-1a16-43b0-8b98-f40d97e35823 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1549 microversion: 2.1 time: 0.177415 Jul 04 08:09:07.061955 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 345/717] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:06 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1549 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:07.078454 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-de2063c6-4f4d-4b1f-908b-e674d4e3eab8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:07.078948 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-de2063c6-4f4d-4b1f-908b-e674d4e3eab8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:07.085331 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de2063c6-4f4d-4b1f-908b-e674d4e3eab8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:07.085904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de2063c6-4f4d-4b1f-908b-e674d4e3eab8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:07.086693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de2063c6-4f4d-4b1f-908b-e674d4e3eab8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:07.087128 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de2063c6-4f4d-4b1f-908b-e674d4e3eab8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:07.176109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-de2063c6-4f4d-4b1f-908b-e674d4e3eab8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102007 Jul 04 08:09:07.176740 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 373/718] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jul 4 08:09:07 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:07.788582 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a8d2095f-4be7-4ec1-8e96-48a915c10817 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:07.789443 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a8d2095f-4be7-4ec1-8e96-48a915c10817 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:07.797373 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8d2095f-4be7-4ec1-8e96-48a915c10817 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:07.797858 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8d2095f-4be7-4ec1-8e96-48a915c10817 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:07.798641 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8d2095f-4be7-4ec1-8e96-48a915c10817 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:07.799075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a8d2095f-4be7-4ec1-8e96-48a915c10817 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:07.954851 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a8d2095f-4be7-4ec1-8e96-48a915c10817 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:07.969458 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a8d2095f-4be7-4ec1-8e96-48a915c10817 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.184288 Jul 04 08:09:07.971052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 346/719] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:07 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:08.179358 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-806ab6c5-ecd6-447c-85e6-6e60889b6829 req-6ebdc48c-a729-4322-89cf-28ce851266ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbad2f2-0053-4c22-a052-48d2265b2c6c", "tag": "86e0ac73-22b7-4a2b-b97c-c96f71ac308a"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:08.190090 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-806ab6c5-ecd6-447c-85e6-6e60889b6829 req-6ebdc48c-a729-4322-89cf-28ce851266ca service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:08.190653 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-806ab6c5-ecd6-447c-85e6-6e60889b6829 req-6ebdc48c-a729-4322-89cf-28ce851266ca service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:08.204149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-806ab6c5-ecd6-447c-85e6-6e60889b6829 req-6ebdc48c-a729-4322-89cf-28ce851266ca service nova] Creating event network-changed:86e0ac73-22b7-4a2b-b97c-c96f71ac308a for instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c on hv-cinder-79760 Jul 04 08:09:08.209349 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-806ab6c5-ecd6-447c-85e6-6e60889b6829 req-6ebdc48c-a729-4322-89cf-28ce851266ca service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034714 Jul 04 08:09:08.210027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 374/720] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:08.989066 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4daa339d-4501-4fa7-9489-bebfa24fe47d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:08.990390 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4daa339d-4501-4fa7-9489-bebfa24fe47d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:08.997886 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4daa339d-4501-4fa7-9489-bebfa24fe47d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:08.998246 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4daa339d-4501-4fa7-9489-bebfa24fe47d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:08.999027 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4daa339d-4501-4fa7-9489-bebfa24fe47d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:08.999460 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4daa339d-4501-4fa7-9489-bebfa24fe47d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:09.241476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4daa339d-4501-4fa7-9489-bebfa24fe47d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:09.250556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4daa339d-4501-4fa7-9489-bebfa24fe47d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1734 microversion: 2.1 time: 0.265525 Jul 04 08:09:09.251165 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 347/721] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:08 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1734 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:10.270512 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab86b2d9-5b5f-47b4-aaaa-aadadd45eb0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:10.271191 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ab86b2d9-5b5f-47b4-aaaa-aadadd45eb0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:10.278630 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab86b2d9-5b5f-47b4-aaaa-aadadd45eb0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:10.278630 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab86b2d9-5b5f-47b4-aaaa-aadadd45eb0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:10.279424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab86b2d9-5b5f-47b4-aaaa-aadadd45eb0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:10.279843 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab86b2d9-5b5f-47b4-aaaa-aadadd45eb0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:10.429601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ab86b2d9-5b5f-47b4-aaaa-aadadd45eb0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:10.438337 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ab86b2d9-5b5f-47b4-aaaa-aadadd45eb0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1714 microversion: 2.1 time: 0.172758 Jul 04 08:09:10.438928 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 375/722] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:10 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1714 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:09:10.557086 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:10.557686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:10.564584 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:10.564967 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:10.565749 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:10.566173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:10.653147 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] HTTP exception thrown: Cannot 'detach_volume' instance 3ab500b1-c48b-483c-978c-c34e45412a3a while it is in vm_state rescued Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Request method failure captured: Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: DELETE /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments/17da7ad1-12a6-4f92-90e1-54767e6ada6a HTTP/1.1 Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp86y5zB6tJmUvnCBxloMYPfz3Qu1J2vZNvALy11_SGklA0-6zpcp9i-qXZg_aKmNOY0KAVoTThFHL2J5xGD8lKRaA6HbDycVJoWay3Tx1aFQSmAK8oaRsWv5iQSyEwBVsMcnSHDiqUgbMRRPkeTzsn1MKqYqaic2Kn1UZ2Z_VEiH1s Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:09:10.654852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ecd5bc804a3b4f14b864fb4e0f8d1b98", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 9e3f73e469f34b66bfbe99c3d79ac129 Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:09:10.656554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Cannot 'detach_volume' instance 3ab500b1-c48b-483c-978c-c34e45412a3a while it is in vm_state rescued Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'server_id': '3ab500b1-c48b-483c-978c-c34e45412a3a', 'id': '17da7ad1-12a6-4f92-90e1-54767e6ada6a'} Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ab500b1-c48b-483c-978c-c34e45412a3a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:09:10.661080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3ab500b1-c48b-483c-978c-c34e45412a3a while it is in vm_state rescued Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3ab500b1-c48b-483c-978c-c34e45412a3a while it is in vm_state rescued Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:09:10.662702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Returning 409 to user: Cannot 'detach_volume' instance 3ab500b1-c48b-483c-978c-c34e45412a3a while it is in vm_state rescued {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:09:10.663919 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fc993616-6ffd-4f5e-a34f-54695a09740b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments/17da7ad1-12a6-4f92-90e1-54767e6ada6a" status: 409 len: 152 microversion: 2.1 time: 0.103309 Jul 04 08:09:10.663919 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 348/723] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:09:10 2022] DELETE /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments/17da7ad1-12a6-4f92-90e1-54767e6ada6a => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 04 08:09:10.666378 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6dec02e2-4aca-442d-bb0f-b86886a26029 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:10.666943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6dec02e2-4aca-442d-bb0f-b86886a26029 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:10.673482 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dec02e2-4aca-442d-bb0f-b86886a26029 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:10.674093 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dec02e2-4aca-442d-bb0f-b86886a26029 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:10.674877 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dec02e2-4aca-442d-bb0f-b86886a26029 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:10.675306 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dec02e2-4aca-442d-bb0f-b86886a26029 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:10.750465 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6dec02e2-4aca-442d-bb0f-b86886a26029 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "POST /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.088005 Jul 04 08:09:10.754919 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 376/724] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:09:10 2022] POST /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 08:09:10.763860 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-11af9bd4-6140-4851-bac7-b72ae8182216 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:10.764584 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-11af9bd4-6140-4851-bac7-b72ae8182216 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:10.773638 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-11af9bd4-6140-4851-bac7-b72ae8182216 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:10.774105 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-11af9bd4-6140-4851-bac7-b72ae8182216 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:10.774892 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-11af9bd4-6140-4851-bac7-b72ae8182216 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:10.775322 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-11af9bd4-6140-4851-bac7-b72ae8182216 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:10.792526 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:11.019721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-11af9bd4-6140-4851-bac7-b72ae8182216 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:11.029740 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-11af9bd4-6140-4851-bac7-b72ae8182216 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1722 microversion: 2.1 time: 0.270667 Jul 04 08:09:11.030349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 349/725] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:10 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:12.051831 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-79615dad-cebe-4fd1-b7b6-b87eb1c79c97 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:12.052884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-79615dad-cebe-4fd1-b7b6-b87eb1c79c97 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:12.062948 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79615dad-cebe-4fd1-b7b6-b87eb1c79c97 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:12.063684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79615dad-cebe-4fd1-b7b6-b87eb1c79c97 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:12.064859 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79615dad-cebe-4fd1-b7b6-b87eb1c79c97 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:12.065500 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79615dad-cebe-4fd1-b7b6-b87eb1c79c97 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:12.209365 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-79615dad-cebe-4fd1-b7b6-b87eb1c79c97 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:12.217532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-79615dad-cebe-4fd1-b7b6-b87eb1c79c97 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1722 microversion: 2.1 time: 0.173519 Jul 04 08:09:12.218157 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 377/726] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:12 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:13.238020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c7a99a15-3325-4d8d-809d-b2321df56373 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:13.238680 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c7a99a15-3325-4d8d-809d-b2321df56373 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:13.249227 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c7a99a15-3325-4d8d-809d-b2321df56373 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:13.249651 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c7a99a15-3325-4d8d-809d-b2321df56373 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:13.250501 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c7a99a15-3325-4d8d-809d-b2321df56373 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:13.250911 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c7a99a15-3325-4d8d-809d-b2321df56373 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:13.399704 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c7a99a15-3325-4d8d-809d-b2321df56373 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:13.409455 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c7a99a15-3325-4d8d-809d-b2321df56373 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1722 microversion: 2.1 time: 0.177359 Jul 04 08:09:13.410116 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 350/727] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:13 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:14.428410 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a9d791ad-c0ad-43ba-87a9-ac3eb2c6f2b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:14.428991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a9d791ad-c0ad-43ba-87a9-ac3eb2c6f2b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:14.435972 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9d791ad-c0ad-43ba-87a9-ac3eb2c6f2b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:14.436418 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9d791ad-c0ad-43ba-87a9-ac3eb2c6f2b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:14.437190 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9d791ad-c0ad-43ba-87a9-ac3eb2c6f2b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:14.437645 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9d791ad-c0ad-43ba-87a9-ac3eb2c6f2b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:14.579265 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a9d791ad-c0ad-43ba-87a9-ac3eb2c6f2b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:14.587860 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a9d791ad-c0ad-43ba-87a9-ac3eb2c6f2b5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1728 microversion: 2.1 time: 0.163445 Jul 04 08:09:14.588455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 378/728] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:14 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:14.606010 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9e9073e9-a8f6-4e81-8356-c7e9c3ab2cf9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:14.606604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9e9073e9-a8f6-4e81-8356-c7e9c3ab2cf9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:14.613388 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e9073e9-a8f6-4e81-8356-c7e9c3ab2cf9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:14.613925 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e9073e9-a8f6-4e81-8356-c7e9c3ab2cf9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:14.614964 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e9073e9-a8f6-4e81-8356-c7e9c3ab2cf9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:14.615481 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e9073e9-a8f6-4e81-8356-c7e9c3ab2cf9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:14.696089 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9e9073e9-a8f6-4e81-8356-c7e9c3ab2cf9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094200 Jul 04 08:09:14.696678 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 351/729] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jul 4 08:09:14 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:09:14.855673 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2ba0981-1b1f-4ff0-9a94-b80406b270c3"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:14.856778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:14.863239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:14.863680 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:14.864439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:14.865222 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:14.955508 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Invalid volume: volume c2ba0981-1b1f-4ff0-9a94-b80406b270c3 is already attached to instances: 7d9919b8-5ba1-4472-b2cc-1faabba0742d Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: POST /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments HTTP/1.1 Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 74 Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:09:14.957218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {"volumeAttachment": {"volumeId": "c2ba0981-1b1f-4ff0-9a94-b80406b270c3"}} Jul 04 08:09:14.959067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Invalid volume: volume c2ba0981-1b1f-4ff0-9a94-b80406b270c3 is already attached to instances: 7d9919b8-5ba1-4472-b2cc-1faabba0742d Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'server_id': '7d9919b8-5ba1-4472-b2cc-1faabba0742d', 'body': {'volumeAttachment': {'volumeId': 'c2ba0981-1b1f-4ff0-9a94-b80406b270c3'}}} Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c2ba0981-1b1f-4ff0-9a94-b80406b270c3 is already attached to instances: 7d9919b8-5ba1-4472-b2cc-1faabba0742d Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:14.959909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c2ba0981-1b1f-4ff0-9a94-b80406b270c3 is already attached to instances: 7d9919b8-5ba1-4472-b2cc-1faabba0742d Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:09:14.961250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:09:14.962682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:09:14.962682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:09:14.962682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:09:14.962682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c2ba0981-1b1f-4ff0-9a94-b80406b270c3 is already attached to instances: 7d9919b8-5ba1-4472-b2cc-1faabba0742d Jul 04 08:09:14.962682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:14.963744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 400 to user: Invalid volume: volume c2ba0981-1b1f-4ff0-9a94-b80406b270c3 is already attached to instances: 7d9919b8-5ba1-4472-b2cc-1faabba0742d {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:09:14.964586 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6269b036-3afe-4958-b5be-b9615f6f5eb7 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113233 Jul 04 08:09:14.965149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 379/730] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:09:14 2022] POST /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:09:15.030692 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6f141b7d-c4af-4cfa-9c4d-515ac3d934be tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:15.031205 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6f141b7d-c4af-4cfa-9c4d-515ac3d934be tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:15.038154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6f141b7d-c4af-4cfa-9c4d-515ac3d934be tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:15.038612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6f141b7d-c4af-4cfa-9c4d-515ac3d934be tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:15.039385 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6f141b7d-c4af-4cfa-9c4d-515ac3d934be tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:15.039819 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6f141b7d-c4af-4cfa-9c4d-515ac3d934be tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:15.122002 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-6f141b7d-c4af-4cfa-9c4d-515ac3d934be tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lazy-loading 'services' on Instance uuid 7d9919b8-5ba1-4472-b2cc-1faabba0742d {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:09:15.209652 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6f141b7d-c4af-4cfa-9c4d-515ac3d934be tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments/c2ba0981-1b1f-4ff0-9a94-b80406b270c3" status: 202 len: 0 microversion: 2.1 time: 0.182540 Jul 04 08:09:15.217887 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 352/731] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:09:15 2022] DELETE /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments/c2ba0981-1b1f-4ff0-9a94-b80406b270c3 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:09:15.218533 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2d5b2560-4bbe-4706-8714-e417f63e8634 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:15.219283 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2d5b2560-4bbe-4706-8714-e417f63e8634 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:15.227175 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d5b2560-4bbe-4706-8714-e417f63e8634 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:15.227615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d5b2560-4bbe-4706-8714-e417f63e8634 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:15.228809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d5b2560-4bbe-4706-8714-e417f63e8634 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:15.228809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d5b2560-4bbe-4706-8714-e417f63e8634 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:15.266050 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2d5b2560-4bbe-4706-8714-e417f63e8634 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051627 Jul 04 08:09:15.266656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 380/732] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:09:15 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:15.650692 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-49309a90-8364-4dd1-bbb4-de15dc1afc9f req-9e01c41c-042c-4152-860c-48c08756b4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab500b1-c48b-483c-978c-c34e45412a3a", "tag": "7cbefb7a-840f-4963-a04b-770627ab4955"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:15.660264 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-49309a90-8364-4dd1-bbb4-de15dc1afc9f req-9e01c41c-042c-4152-860c-48c08756b4d3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:15.660831 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-49309a90-8364-4dd1-bbb4-de15dc1afc9f req-9e01c41c-042c-4152-860c-48c08756b4d3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:15.675874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-49309a90-8364-4dd1-bbb4-de15dc1afc9f req-9e01c41c-042c-4152-860c-48c08756b4d3 service nova] Creating event network-changed:7cbefb7a-840f-4963-a04b-770627ab4955 for instance 3ab500b1-c48b-483c-978c-c34e45412a3a on hv-cinder-79760 Jul 04 08:09:15.680880 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-49309a90-8364-4dd1-bbb4-de15dc1afc9f req-9e01c41c-042c-4152-860c-48c08756b4d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034831 Jul 04 08:09:15.681497 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 353/733] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:16.279496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ef50a65b-d028-4c92-b32b-a03e612d2f2d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:16.281249 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ef50a65b-d028-4c92-b32b-a03e612d2f2d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:16.288718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ef50a65b-d028-4c92-b32b-a03e612d2f2d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:16.289156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ef50a65b-d028-4c92-b32b-a03e612d2f2d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:16.289968 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ef50a65b-d028-4c92-b32b-a03e612d2f2d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:16.290369 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ef50a65b-d028-4c92-b32b-a03e612d2f2d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:16.324323 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ef50a65b-d028-4c92-b32b-a03e612d2f2d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049524 Jul 04 08:09:16.324921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 381/734] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:09:16 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:17.338297 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c8aed842-d0aa-4d73-b729-1a7b5e85589e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:17.339350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c8aed842-d0aa-4d73-b729-1a7b5e85589e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:17.341391 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:17.348184 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8aed842-d0aa-4d73-b729-1a7b5e85589e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:17.348633 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8aed842-d0aa-4d73-b729-1a7b5e85589e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:17.349516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8aed842-d0aa-4d73-b729-1a7b5e85589e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:17.349950 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8aed842-d0aa-4d73-b729-1a7b5e85589e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:17.384889 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c8aed842-d0aa-4d73-b729-1a7b5e85589e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051427 Jul 04 08:09:17.385379 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 354/735] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:09:17 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 08:09:17.450185 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1675c1d9-6917-4f2e-adcb-74e4dd656158 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:17.450737 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1675c1d9-6917-4f2e-adcb-74e4dd656158 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:17.453740 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:17.460051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1675c1d9-6917-4f2e-adcb-74e4dd656158 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:17.460588 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1675c1d9-6917-4f2e-adcb-74e4dd656158 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:17.461393 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1675c1d9-6917-4f2e-adcb-74e4dd656158 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:17.461879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1675c1d9-6917-4f2e-adcb-74e4dd656158 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:17.491153 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1675c1d9-6917-4f2e-adcb-74e4dd656158 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:09:17.506859 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:17.586882 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1675c1d9-6917-4f2e-adcb-74e4dd656158 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 204 len: 0 microversion: 2.1 time: 0.140229 Jul 04 08:09:17.587941 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 382/736] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:09:17 2022] DELETE /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:09:17.599158 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6530fa14-0183-48f8-a011-20f0b6c9bb78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:17.599876 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6530fa14-0183-48f8-a011-20f0b6c9bb78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:17.607140 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6530fa14-0183-48f8-a011-20f0b6c9bb78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:17.607582 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6530fa14-0183-48f8-a011-20f0b6c9bb78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:17.608365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6530fa14-0183-48f8-a011-20f0b6c9bb78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:17.608792 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6530fa14-0183-48f8-a011-20f0b6c9bb78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:17.762786 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-40be600d-64e4-4da0-a367-b7f7f3c776a6 req-be779158-11f6-4b54-9dd4-f6768646b652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ab500b1-c48b-483c-978c-c34e45412a3a", "tag": "7cbefb7a-840f-4963-a04b-770627ab4955"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:17.773985 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-40be600d-64e4-4da0-a367-b7f7f3c776a6 req-be779158-11f6-4b54-9dd4-f6768646b652 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:17.774613 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-40be600d-64e4-4da0-a367-b7f7f3c776a6 req-be779158-11f6-4b54-9dd4-f6768646b652 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:17.791599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-40be600d-64e4-4da0-a367-b7f7f3c776a6 req-be779158-11f6-4b54-9dd4-f6768646b652 service nova] Creating event network-changed:7cbefb7a-840f-4963-a04b-770627ab4955 for instance 3ab500b1-c48b-483c-978c-c34e45412a3a on hv-cinder-79760 Jul 04 08:09:17.793066 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6530fa14-0183-48f8-a011-20f0b6c9bb78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:17.797941 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-40be600d-64e4-4da0-a367-b7f7f3c776a6 req-be779158-11f6-4b54-9dd4-f6768646b652 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106192 Jul 04 08:09:17.798659 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 383/737] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:17.802132 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6530fa14-0183-48f8-a011-20f0b6c9bb78 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1679 microversion: 2.1 time: 0.207645 Jul 04 08:09:17.802718 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 355/738] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:17 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:18.823794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e2c64068-4801-435c-a9d7-9927f8e2a48c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:18.824796 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e2c64068-4801-435c-a9d7-9927f8e2a48c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:18.832963 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2c64068-4801-435c-a9d7-9927f8e2a48c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:18.833415 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2c64068-4801-435c-a9d7-9927f8e2a48c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:18.834211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2c64068-4801-435c-a9d7-9927f8e2a48c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:18.834644 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e2c64068-4801-435c-a9d7-9927f8e2a48c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:18.982636 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e2c64068-4801-435c-a9d7-9927f8e2a48c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:18.991716 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e2c64068-4801-435c-a9d7-9927f8e2a48c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1679 microversion: 2.1 time: 0.175000 Jul 04 08:09:18.992293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 384/739] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:18 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:20.010885 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7b20b4e6-df3b-4fba-b1d1-e0a16c48d4ab tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:20.011510 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7b20b4e6-df3b-4fba-b1d1-e0a16c48d4ab tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:20.019134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b20b4e6-df3b-4fba-b1d1-e0a16c48d4ab tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:20.019593 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b20b4e6-df3b-4fba-b1d1-e0a16c48d4ab tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:20.020383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b20b4e6-df3b-4fba-b1d1-e0a16c48d4ab tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:20.020815 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b20b4e6-df3b-4fba-b1d1-e0a16c48d4ab tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:20.272346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7b20b4e6-df3b-4fba-b1d1-e0a16c48d4ab tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:20.281178 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7b20b4e6-df3b-4fba-b1d1-e0a16c48d4ab tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1679 microversion: 2.1 time: 0.273593 Jul 04 08:09:20.282157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 356/740] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:20 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1679 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:20.810521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-1e293092-b1cf-4e5a-8316-37c98c0e53da req-56b6ddd3-8a58-4f08-b8ce-f72586286f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9919b8-5ba1-4472-b2cc-1faabba0742d", "name": "network-vif-deleted", "tag": "560a2ae0-d66b-4604-b2a4-4879a9ad91a3"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:20.828507 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1e293092-b1cf-4e5a-8316-37c98c0e53da req-56b6ddd3-8a58-4f08-b8ce-f72586286f41 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:20.832491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1e293092-b1cf-4e5a-8316-37c98c0e53da req-56b6ddd3-8a58-4f08-b8ce-f72586286f41 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:20.855038 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-1e293092-b1cf-4e5a-8316-37c98c0e53da req-56b6ddd3-8a58-4f08-b8ce-f72586286f41 service nova] Creating event network-vif-deleted:560a2ae0-d66b-4604-b2a4-4879a9ad91a3 for instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d on hv-cinder-79760 Jul 04 08:09:20.867449 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-1e293092-b1cf-4e5a-8316-37c98c0e53da req-56b6ddd3-8a58-4f08-b8ce-f72586286f41 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176965 Jul 04 08:09:20.868851 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 385/741] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:21.302227 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:21.303011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:21.310770 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:21.311859 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:21.312926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:21.313422 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:21.349156 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:21.349780 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:21.350268 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lazy-loading 'fault' on Instance uuid 7d9919b8-5ba1-4472-b2cc-1faabba0742d {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:09:21.398856 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:21.408180 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e0dbd7d0-dba1-4a19-9353-211c40351889 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 200 len: 1330 microversion: 2.1 time: 0.111392 Jul 04 08:09:21.409108 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 357/742] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:21 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:22.433443 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:22.434152 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:22.441522 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:22.442004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:22.442793 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:22.443225 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:22.458326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d HTTP/1.1 Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:09:22.460039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:09:22.461550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '7d9919b8-5ba1-4472-b2cc-1faabba0742d'} Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:09:22.462380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:09:22.463671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:09:22.464784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:09:22.464784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c89d1ba3-b449-45e4-8caf-366ae59f6855 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 404 len: 111 microversion: 2.1 time: 0.032585 Jul 04 08:09:22.464784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 386/743] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:22 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:09:22.471439 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7f4edbed-9809-4fbe-99ce-07cb2d20004a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '.version_select at 0x7f05e55b1790>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:22.493251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7f4edbed-9809-4fbe-99ce-07cb2d20004a tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-292627276" status: 202 len: 0 microversion: 2.1 time: 0.025702 Jul 04 08:09:22.494356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 358/744] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jul 4 08:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-292627276 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:09:23.212786 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d1073e00-26d6-48b7-8a8f-9e661da618cf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: .version_select at 0x7f05e553c0d0>, body: {"keypair": {"name": "tempest-keypair-495000353", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgQnCwCe2YnBHQZ5AK6/RNcTA0Qz6tqS/y3qbRtFjPKjF9EYOilY2h1Ld+Q+Cw3NNRSZqsPJQgdgANY+yZGeHJgByg2bM+by4dI1SxnjcnBHs/I/MshfuVgfNHF9PhhZQ=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:23.227397 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-d1073e00-26d6-48b7-8a8f-9e661da618cf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for project de5226d001fb47b399172b6633fec844. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:09:23.231783 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-d1073e00-26d6-48b7-8a8f-9e661da618cf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for user 126ba607541e4c4895b47b4b7602ce01 and project de5226d001fb47b399172b6633fec844. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:09:23.261002 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d1073e00-26d6-48b7-8a8f-9e661da618cf tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051772 Jul 04 08:09:23.261738 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 387/745] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:09:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:24.895081 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-797581209", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e86146d1-c8e4-49f2-af91-e63989951c39"}], "security_groups": [{"name": "tempest-securitygroup--388181845"}], "key_name": "tempest-keypair-495000353", "user_data": "}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:25.008534 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cd3c84c7-01c9-43d3-b0c1-a9ac0a178e96 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:25.009145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cd3c84c7-01c9-43d3-b0c1-a9ac0a178e96 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:25.021992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd3c84c7-01c9-43d3-b0c1-a9ac0a178e96 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:25.022456 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd3c84c7-01c9-43d3-b0c1-a9ac0a178e96 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:25.022589 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] validate_networks() for [('e86146d1-c8e4-49f2-af91-e63989951c39', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:09:25.023244 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd3c84c7-01c9-43d3-b0c1-a9ac0a178e96 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:25.023678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd3c84c7-01c9-43d3-b0c1-a9ac0a178e96 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:25.050706 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cd3c84c7-01c9-43d3-b0c1-a9ac0a178e96 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/ips" status: 200 len: 153 microversion: 2.20 time: 0.105695 Jul 04 08:09:25.051312 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 388/746] 10.222.0.43 () {60 vars in 1288 bytes} [Mon Jul 4 08:09:24 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/ips => generated 153 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 04 08:09:25.511697 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:09:25.512119 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:09:25.512590 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:09:25.512996 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:09:25.513407 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:09:25.523064 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:25.523505 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:25.524307 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:25.524738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:25.542287 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for project de5226d001fb47b399172b6633fec844. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:09:25.546568 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Getting quotas for user 126ba607541e4c4895b47b4b7602ce01 and project de5226d001fb47b399172b6633fec844. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:09:25.559329 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:09:25.561709 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:09:25.608907 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-286f827a-44de-4cff-b3c2-e116199ca2e1 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.719554 Jul 04 08:09:25.609555 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 359/747] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:09:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:09:25.619506 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c995ad50-9bd1-4d48-85b3-6bcece400dd0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:25.620109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c995ad50-9bd1-4d48-85b3-6bcece400dd0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:25.680417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c995ad50-9bd1-4d48-85b3-6bcece400dd0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:25.687845 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c995ad50-9bd1-4d48-85b3-6bcece400dd0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1240 microversion: 2.1 time: 0.072098 Jul 04 08:09:25.688458 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 389/748] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:25 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:26.706303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-06ec1566-a181-4332-b1ff-36ca3878945d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:26.706885 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-06ec1566-a181-4332-b1ff-36ca3878945d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:26.713966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-06ec1566-a181-4332-b1ff-36ca3878945d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:26.714412 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-06ec1566-a181-4332-b1ff-36ca3878945d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:26.715175 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-06ec1566-a181-4332-b1ff-36ca3878945d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:26.715648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-06ec1566-a181-4332-b1ff-36ca3878945d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:26.779591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-06ec1566-a181-4332-b1ff-36ca3878945d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:26.787778 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-06ec1566-a181-4332-b1ff-36ca3878945d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1292 microversion: 2.1 time: 0.086198 Jul 04 08:09:26.788368 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 360/749] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:26 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:26.990873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-98969dd5-e840-4273-95db-99078346904e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:26.991465 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-98969dd5-e840-4273-95db-99078346904e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:26.998417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98969dd5-e840-4273-95db-99078346904e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:26.998885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98969dd5-e840-4273-95db-99078346904e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:26.999737 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98969dd5-e840-4273-95db-99078346904e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:27.000166 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98969dd5-e840-4273-95db-99078346904e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:27.027474 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-98969dd5-e840-4273-95db-99078346904e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lazy-loading 'flavor' on Instance uuid 5eb350cf-6a02-4ede-be92-0a7863bc0475 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:09:27.302692 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-98969dd5-e840-4273-95db-99078346904e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/action" status: 202 len: 0 microversion: 2.20 time: 0.315690 Jul 04 08:09:27.303318 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 390/750] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Jul 4 08:09:26 2022] POST /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:09:27.312353 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:27.312967 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:27.319469 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:27.319922 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:27.320686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:27.321122 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:27.541354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:27.550514 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:27.552084 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:27.553610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8118a54a-9416-45b0-9953-d4358a66747b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.245841 Jul 04 08:09:27.554276 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 361/751] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:27 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:27.805389 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-737e526b-80c5-48ab-a4e1-2c1634c1e2ca tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:27.805989 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-737e526b-80c5-48ab-a4e1-2c1634c1e2ca tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:27.815188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-737e526b-80c5-48ab-a4e1-2c1634c1e2ca tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:27.815642 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-737e526b-80c5-48ab-a4e1-2c1634c1e2ca tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:27.816412 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-737e526b-80c5-48ab-a4e1-2c1634c1e2ca tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:27.816823 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-737e526b-80c5-48ab-a4e1-2c1634c1e2ca tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:27.882636 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-737e526b-80c5-48ab-a4e1-2c1634c1e2ca tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:27.891324 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-737e526b-80c5-48ab-a4e1-2c1634c1e2ca tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1298 microversion: 2.1 time: 0.090411 Jul 04 08:09:27.892007 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 391/752] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:27 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:28.575063 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:28.575862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:28.584337 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:28.584756 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:28.585532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:28.585987 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:28.817131 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:28.826991 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:28.829168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:28.830491 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-19fbaee4-454e-4353-9e69-33f1d3846b0c tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.259538 Jul 04 08:09:28.831080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 362/753] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:28 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:28.887868 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-0bf14279-1332-4632-8710-e159f5c4b96f req-8a643023-afd3-449f-96a4-ade6802ce117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b07442-ab28-4f72-8fbd-36f683a8f50c", "tag": "c51aca95-0a5f-4a71-85e2-e526a34214aa"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:28.901582 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-0bf14279-1332-4632-8710-e159f5c4b96f req-8a643023-afd3-449f-96a4-ade6802ce117 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:28.904622 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-0bf14279-1332-4632-8710-e159f5c4b96f req-8a643023-afd3-449f-96a4-ade6802ce117 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:28.912308 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-20c39e3c-87df-4e59-a0aa-cd32fea1c4f0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:28.913747 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-20c39e3c-87df-4e59-a0aa-cd32fea1c4f0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:28.920624 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-0bf14279-1332-4632-8710-e159f5c4b96f req-8a643023-afd3-449f-96a4-ade6802ce117 service nova] Creating event network-changed:c51aca95-0a5f-4a71-85e2-e526a34214aa for instance a4b07442-ab28-4f72-8fbd-36f683a8f50c on hv-cinder-79760 Jul 04 08:09:28.925075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20c39e3c-87df-4e59-a0aa-cd32fea1c4f0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:28.926173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20c39e3c-87df-4e59-a0aa-cd32fea1c4f0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:28.927288 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-0bf14279-1332-4632-8710-e159f5c4b96f req-8a643023-afd3-449f-96a4-ade6802ce117 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043129 Jul 04 08:09:28.927922 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20c39e3c-87df-4e59-a0aa-cd32fea1c4f0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:28.928242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 392/754] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:09:28.929387 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20c39e3c-87df-4e59-a0aa-cd32fea1c4f0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:29.198582 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-20c39e3c-87df-4e59-a0aa-cd32fea1c4f0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:29.208197 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-20c39e3c-87df-4e59-a0aa-cd32fea1c4f0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1365 microversion: 2.1 time: 0.302315 Jul 04 08:09:29.208847 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 363/755] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:28 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:29.849744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:29.850355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:29.857084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:29.857584 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:29.858524 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:29.858955 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:29.996590 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:30.010112 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:30.012565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:30.014573 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4311c5ff-68f6-45e8-9701-4d4c0ddfd4d6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.168874 Jul 04 08:09:30.015240 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 393/756] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:29 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:30.226175 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-135cc290-eb9a-4ef2-9e72-caf76ad0ff3c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:30.226870 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-135cc290-eb9a-4ef2-9e72-caf76ad0ff3c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:30.234434 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-135cc290-eb9a-4ef2-9e72-caf76ad0ff3c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:30.234958 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-135cc290-eb9a-4ef2-9e72-caf76ad0ff3c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:30.235751 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-135cc290-eb9a-4ef2-9e72-caf76ad0ff3c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:30.236183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-135cc290-eb9a-4ef2-9e72-caf76ad0ff3c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:30.382465 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-135cc290-eb9a-4ef2-9e72-caf76ad0ff3c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:30.390840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-135cc290-eb9a-4ef2-9e72-caf76ad0ff3c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1365 microversion: 2.1 time: 0.168665 Jul 04 08:09:30.391429 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 364/757] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:30 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:09:31.033268 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:31.033950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:31.041909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:31.042353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:31.043165 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:31.043589 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:31.199597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:31.208899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:31.210447 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:31.211638 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-aee75bc2-93eb-4b87-b463-a54a1aed9577 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.182624 Jul 04 08:09:31.212203 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 394/758] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:31 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:31.408610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2f10787a-df2c-4e14-9096-c4cf72947b58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:31.409276 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2f10787a-df2c-4e14-9096-c4cf72947b58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:31.416120 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f10787a-df2c-4e14-9096-c4cf72947b58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:31.416584 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f10787a-df2c-4e14-9096-c4cf72947b58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:31.417376 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f10787a-df2c-4e14-9096-c4cf72947b58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:31.417845 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f10787a-df2c-4e14-9096-c4cf72947b58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:31.772041 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2f10787a-df2c-4e14-9096-c4cf72947b58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:31.780339 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2f10787a-df2c-4e14-9096-c4cf72947b58 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1365 microversion: 2.1 time: 0.375757 Jul 04 08:09:31.781274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 365/759] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:31 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1365 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:32.230691 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:32.231275 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:32.239355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:32.240036 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:32.241133 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:32.241395 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:32.394262 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:32.405725 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:32.408716 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:32.410326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4a32afd0-c445-407a-bb58-60283420d135 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.183657 Jul 04 08:09:32.410906 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 395/760] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:32 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:32.802415 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-00835152-1e49-4d23-845d-48890eef5fef tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:32.803019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-00835152-1e49-4d23-845d-48890eef5fef tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:32.812036 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00835152-1e49-4d23-845d-48890eef5fef tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:32.812471 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00835152-1e49-4d23-845d-48890eef5fef tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:32.813231 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00835152-1e49-4d23-845d-48890eef5fef tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:32.813683 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00835152-1e49-4d23-845d-48890eef5fef tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:32.949862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-00835152-1e49-4d23-845d-48890eef5fef tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:32.958612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-00835152-1e49-4d23-845d-48890eef5fef tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1365 microversion: 2.1 time: 0.162817 Jul 04 08:09:32.959198 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 366/761] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:32 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:33.431550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:33.432275 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:33.440088 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:33.440547 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:33.441319 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:33.441789 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:33.580064 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:33.593471 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:33.595021 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:33.596189 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-28d9e2d7-0d94-4bbe-a7bc-2dc7a19de972 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.168697 Jul 04 08:09:33.596790 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 396/762] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:33 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:33.976206 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-09c3ce85-c789-4f43-8ef3-0a88f1a9f99c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:33.976850 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-09c3ce85-c789-4f43-8ef3-0a88f1a9f99c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:33.984982 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09c3ce85-c789-4f43-8ef3-0a88f1a9f99c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:33.985731 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09c3ce85-c789-4f43-8ef3-0a88f1a9f99c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:33.986515 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09c3ce85-c789-4f43-8ef3-0a88f1a9f99c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:33.986948 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09c3ce85-c789-4f43-8ef3-0a88f1a9f99c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:34.135966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-09c3ce85-c789-4f43-8ef3-0a88f1a9f99c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:34.138650 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:34.148462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-09c3ce85-c789-4f43-8ef3-0a88f1a9f99c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1365 microversion: 2.1 time: 0.176248 Jul 04 08:09:34.149961 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 367/763] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:33 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:34.174199 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-3e6e5d3c-f554-4a2c-b7a4-01ca75d245e5 req-90a5e644-9fe3-4293-9818-0d9c9b659fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b07442-ab28-4f72-8fbd-36f683a8f50c", "name": "network-vif-plugged", "status": "completed", "tag": "c51aca95-0a5f-4a71-85e2-e526a34214aa"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:34.183328 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-3e6e5d3c-f554-4a2c-b7a4-01ca75d245e5 req-90a5e644-9fe3-4293-9818-0d9c9b659fa3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:34.183676 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-3e6e5d3c-f554-4a2c-b7a4-01ca75d245e5 req-90a5e644-9fe3-4293-9818-0d9c9b659fa3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:34.196482 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-3e6e5d3c-f554-4a2c-b7a4-01ca75d245e5 req-90a5e644-9fe3-4293-9818-0d9c9b659fa3 service nova] Creating event network-vif-plugged:c51aca95-0a5f-4a71-85e2-e526a34214aa for instance a4b07442-ab28-4f72-8fbd-36f683a8f50c on hv-cinder-79760 Jul 04 08:09:34.201472 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-3e6e5d3c-f554-4a2c-b7a4-01ca75d245e5 req-90a5e644-9fe3-4293-9818-0d9c9b659fa3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107302 Jul 04 08:09:34.202351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 397/764] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:34.615173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:34.615844 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:34.623318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:34.623734 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:34.624521 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:34.625030 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:34.774705 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:34.783139 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:34.784645 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:34.785848 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d74e27a6-f73f-4a8c-8e49-b393b2d0d39b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.174683 Jul 04 08:09:34.786462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 368/765] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:34 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:35.167407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6d59733c-0e66-4bf4-8df6-cff17a9907dd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:35.168102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6d59733c-0e66-4bf4-8df6-cff17a9907dd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:35.175419 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d59733c-0e66-4bf4-8df6-cff17a9907dd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:35.175856 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d59733c-0e66-4bf4-8df6-cff17a9907dd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:35.176646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d59733c-0e66-4bf4-8df6-cff17a9907dd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:35.177094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d59733c-0e66-4bf4-8df6-cff17a9907dd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:35.331718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6d59733c-0e66-4bf4-8df6-cff17a9907dd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:35.339675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6d59733c-0e66-4bf4-8df6-cff17a9907dd tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1365 microversion: 2.1 time: 0.176926 Jul 04 08:09:35.340265 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 398/766] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:35 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:35.804929 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:35.805711 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:35.808397 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:35.809130 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:35.816820 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:35.817264 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:35.818078 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:35.818510 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:35.963609 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:35.972468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:35.974002 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:35.975174 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c8d6e6bc-e612-46ea-9ecc-6ca696da4bc3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.174407 Jul 04 08:09:35.975737 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 369/767] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:35 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:36.358957 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2ceae31a-ae29-4c95-bde1-f25c8052d487 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:36.359544 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2ceae31a-ae29-4c95-bde1-f25c8052d487 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:36.362023 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:36.368182 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2ceae31a-ae29-4c95-bde1-f25c8052d487 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:36.368627 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2ceae31a-ae29-4c95-bde1-f25c8052d487 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:36.369395 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2ceae31a-ae29-4c95-bde1-f25c8052d487 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:36.369861 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2ceae31a-ae29-4c95-bde1-f25c8052d487 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:36.507982 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2ceae31a-ae29-4c95-bde1-f25c8052d487 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:36.516128 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2ceae31a-ae29-4c95-bde1-f25c8052d487 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1556 microversion: 2.1 time: 0.162240 Jul 04 08:09:36.516710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 399/768] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:36 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:36.535235 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2d7069e5-f1dc-4d3f-ac22-43b26d9a48c0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:36.535750 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2d7069e5-f1dc-4d3f-ac22-43b26d9a48c0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:36.542292 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d7069e5-f1dc-4d3f-ac22-43b26d9a48c0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:36.542740 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d7069e5-f1dc-4d3f-ac22-43b26d9a48c0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:36.543523 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d7069e5-f1dc-4d3f-ac22-43b26d9a48c0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:36.543952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2d7069e5-f1dc-4d3f-ac22-43b26d9a48c0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:36.630406 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2d7069e5-f1dc-4d3f-ac22-43b26d9a48c0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099289 Jul 04 08:09:36.630969 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 370/769] 10.222.0.43 () {58 vars in 1274 bytes} [Mon Jul 4 08:09:36 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:36.994285 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:36.994901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:37.002141 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:37.003102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:37.003919 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:37.004331 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:37.220027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:37.228338 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:37.229952 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:37.231195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b2390a1b-c9a9-4979-8330-5bff03d6112b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.240999 Jul 04 08:09:37.231886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 400/770] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:36 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:37.701011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-f0f31b3e-c51d-4e54-b490-acd07f38cceb req-60628882-221a-4477-85e5-a03820a9b9ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4b07442-ab28-4f72-8fbd-36f683a8f50c", "tag": "c51aca95-0a5f-4a71-85e2-e526a34214aa"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:37.709489 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f0f31b3e-c51d-4e54-b490-acd07f38cceb req-60628882-221a-4477-85e5-a03820a9b9ae service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:37.709971 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f0f31b3e-c51d-4e54-b490-acd07f38cceb req-60628882-221a-4477-85e5-a03820a9b9ae service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:37.721435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-f0f31b3e-c51d-4e54-b490-acd07f38cceb req-60628882-221a-4477-85e5-a03820a9b9ae service nova] Creating event network-changed:c51aca95-0a5f-4a71-85e2-e526a34214aa for instance a4b07442-ab28-4f72-8fbd-36f683a8f50c on hv-cinder-79760 Jul 04 08:09:37.726748 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-f0f31b3e-c51d-4e54-b490-acd07f38cceb req-60628882-221a-4477-85e5-a03820a9b9ae service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029954 Jul 04 08:09:37.727345 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 371/771] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:38.251176 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:38.253090 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:38.260655 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:38.261100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:38.261892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:38.262670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:38.411967 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:38.415052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:38.424212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:38.426911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:38.429373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-daba076b-8110-4943-a75e-ce9b694505eb tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1747 microversion: 2.20 time: 0.183095 Jul 04 08:09:38.430157 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 401/772] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:38 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1747 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:39.450297 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:39.450897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:39.460384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:39.460933 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:39.462062 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:39.462562 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:39.607379 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:39.616104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:39.617610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:39.618809 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d13cfca3-5dd1-4b31-b60c-e0366a61fb9b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1747 microversion: 2.20 time: 0.173738 Jul 04 08:09:39.619350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 372/773] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:39 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1747 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:40.640967 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:40.641587 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:40.649170 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:40.649656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:40.650418 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:40.650843 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:40.795288 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:40.803733 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:40.805223 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:40.806424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c15e79ac-8b12-4f3b-b478-af7159b53935 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1747 microversion: 2.20 time: 0.170983 Jul 04 08:09:40.806992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 402/774] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:40 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1747 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:41.828803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:41.829389 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:41.839332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:41.839785 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:41.840880 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:41.841304 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:41.995463 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:42.006847 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:42.008586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:42.009793 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-591daa39-84be-4651-b285-b5a2b5a6dbd0 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1742 microversion: 2.20 time: 0.185297 Jul 04 08:09:42.025310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 373/775] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:41 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1742 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:42.170658 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-2308691b-1336-45a5-9bd0-d8853c021830 req-f77914b4-e43a-4161-9935-a5550ea3eec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb350cf-6a02-4ede-be92-0a7863bc0475", "name": "network-vif-plugged", "status": "completed", "tag": "b71d89e6-8615-4c4e-8651-e32f4872be93"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:42.182836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2308691b-1336-45a5-9bd0-d8853c021830 req-f77914b4-e43a-4161-9935-a5550ea3eec0 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:42.184453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2308691b-1336-45a5-9bd0-d8853c021830 req-f77914b4-e43a-4161-9935-a5550ea3eec0 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:42.201075 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-2308691b-1336-45a5-9bd0-d8853c021830 req-f77914b4-e43a-4161-9935-a5550ea3eec0 service nova] Creating event network-vif-plugged:b71d89e6-8615-4c4e-8651-e32f4872be93 for instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 on hv-cinder-79760 Jul 04 08:09:42.207647 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-2308691b-1336-45a5-9bd0-d8853c021830 req-f77914b4-e43a-4161-9935-a5550ea3eec0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041553 Jul 04 08:09:42.209397 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 403/776] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:09:43.030689 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:43.041644 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:43.054065 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:43.058006 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:43.058933 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:43.059287 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:43.249965 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:43.260120 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:43.261929 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:43.263268 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eab496b3-a98c-4e77-9580-ade7f32444c2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1742 microversion: 2.20 time: 0.236798 Jul 04 08:09:43.274837 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 374/777] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:43 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1742 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:44.284143 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:44.284991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:44.293659 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:44.294111 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:44.294991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:44.295721 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:44.488181 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:44.504682 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:44.508147 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:44.510443 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bb3498db-f038-477d-b700-0b5fd5a5c8de tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1742 microversion: 2.20 time: 0.231093 Jul 04 08:09:44.525360 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 404/778] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:44 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1742 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:45.543380 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:45.544486 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:45.557425 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:45.558272 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:45.559732 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:45.561021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:45.776467 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:45.796003 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:45.799303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:45.803106 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1bee760b-6ba8-421f-9882-5a1325f40937 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1742 microversion: 2.20 time: 0.265939 Jul 04 08:09:45.809609 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 375/779] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:45 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1742 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:46.837659 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:46.838434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:46.845686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:46.846527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:46.847375 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:46.847872 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:47.031744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:47.041017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:47.042639 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:47.043941 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-df01f1ed-6f9e-423f-bb6e-455a66edbf1b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1742 microversion: 2.20 time: 0.211163 Jul 04 08:09:47.044694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 405/780] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:46 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1742 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:47.724150 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3504711c-7696-4790-b32a-63e58c2cba92 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:47.725351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3504711c-7696-4790-b32a-63e58c2cba92 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:47.729794 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:47.735870 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3504711c-7696-4790-b32a-63e58c2cba92 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:47.736685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3504711c-7696-4790-b32a-63e58c2cba92 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:47.737472 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3504711c-7696-4790-b32a-63e58c2cba92 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:47.737923 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3504711c-7696-4790-b32a-63e58c2cba92 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:47.771218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-3504711c-7696-4790-b32a-63e58c2cba92 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lazy-loading 'flavor' on Instance uuid 52bf7886-bd99-4926-bb03-78d6488963f8 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:09:47.881877 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3504711c-7696-4790-b32a-63e58c2cba92 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "POST /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8/action" status: 202 len: 0 microversion: 2.1 time: 0.162072 Jul 04 08:09:47.893555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b97f2536-078a-4976-acf2-9c94293c5410 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:47.896194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b97f2536-078a-4976-acf2-9c94293c5410 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:47.899441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 376/781] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:09:47 2022] POST /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:09:47.905848 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:47.908816 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b97f2536-078a-4976-acf2-9c94293c5410 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:47.909705 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b97f2536-078a-4976-acf2-9c94293c5410 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:47.911019 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b97f2536-078a-4976-acf2-9c94293c5410 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:47.911677 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b97f2536-078a-4976-acf2-9c94293c5410 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:48.066776 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:48.067854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:48.075090 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:48.075687 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:48.077260 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:48.078428 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:48.105200 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b97f2536-078a-4976-acf2-9c94293c5410 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:48.114770 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b97f2536-078a-4976-acf2-9c94293c5410 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.226779 Jul 04 08:09:48.116836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 406/782] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:47 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:48.255036 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:48.264876 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:48.266666 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:48.268026 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b73c2161-3fdb-4017-97e0-33b030c019a6 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1742 microversion: 2.20 time: 0.208763 Jul 04 08:09:48.268612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 377/783] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:48 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1742 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:49.137027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f7a3197a-a5f7-4a2b-839a-627e95c641f2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:49.137703 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f7a3197a-a5f7-4a2b-839a-627e95c641f2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:49.145433 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7a3197a-a5f7-4a2b-839a-627e95c641f2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:49.145932 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7a3197a-a5f7-4a2b-839a-627e95c641f2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:49.146691 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7a3197a-a5f7-4a2b-839a-627e95c641f2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:49.147082 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7a3197a-a5f7-4a2b-839a-627e95c641f2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:49.288366 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:49.288979 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:49.305250 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:49.306208 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:49.307157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:49.307589 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:49.310579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f7a3197a-a5f7-4a2b-839a-627e95c641f2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:49.319513 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f7a3197a-a5f7-4a2b-839a-627e95c641f2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.186430 Jul 04 08:09:49.320407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 407/784] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:49 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:49.472996 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:49.482698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:49.484454 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:49.485665 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a3898794-09ff-470f-9809-27b89f509b0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1742 microversion: 2.20 time: 0.202404 Jul 04 08:09:49.486571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 378/785] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:49 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1742 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:50.338970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b05e6fe8-f49a-4a09-8605-0272a04348c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:50.340321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b05e6fe8-f49a-4a09-8605-0272a04348c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:50.347375 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b05e6fe8-f49a-4a09-8605-0272a04348c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:50.348203 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b05e6fe8-f49a-4a09-8605-0272a04348c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:50.349239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b05e6fe8-f49a-4a09-8605-0272a04348c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:50.349773 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b05e6fe8-f49a-4a09-8605-0272a04348c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:50.499957 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b05e6fe8-f49a-4a09-8605-0272a04348c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:50.505014 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:50.505738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:50.512248 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:50.512789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:50.513661 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:50.514411 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:50.515321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b05e6fe8-f49a-4a09-8605-0272a04348c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.179791 Jul 04 08:09:50.516891 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 408/786] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:50 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:50.677732 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:50.686743 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:50.688934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:50.690217 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-00665d8e-c415-4036-9c1c-00f9bb9b2350 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1742 microversion: 2.20 time: 0.189435 Jul 04 08:09:50.691002 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 379/787] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:50 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:09:51.533317 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5aa6b3bd-0355-4048-87c4-5192bfb2a366 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:51.534003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5aa6b3bd-0355-4048-87c4-5192bfb2a366 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:51.543391 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5aa6b3bd-0355-4048-87c4-5192bfb2a366 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:51.544113 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5aa6b3bd-0355-4048-87c4-5192bfb2a366 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:51.545503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5aa6b3bd-0355-4048-87c4-5192bfb2a366 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:51.546154 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5aa6b3bd-0355-4048-87c4-5192bfb2a366 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:51.716151 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:51.717011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:51.724268 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5aa6b3bd-0355-4048-87c4-5192bfb2a366 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:51.725864 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:51.726307 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:51.727381 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:51.727941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:51.733914 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5aa6b3bd-0355-4048-87c4-5192bfb2a366 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.204094 Jul 04 08:09:51.734610 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 409/788] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:51 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:09:51.856102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-139219d5-bef9-4160-80dd-c1a07069098f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:51.856580 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-139219d5-bef9-4160-80dd-c1a07069098f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:51.864484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-139219d5-bef9-4160-80dd-c1a07069098f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:51.864933 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-139219d5-bef9-4160-80dd-c1a07069098f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:51.865742 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-139219d5-bef9-4160-80dd-c1a07069098f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:51.866165 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-139219d5-bef9-4160-80dd-c1a07069098f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:51.891452 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-139219d5-bef9-4160-80dd-c1a07069098f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/ips" status: 200 len: 146 microversion: 2.1 time: 0.039226 Jul 04 08:09:51.892062 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 410/789] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:09:51 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:51.934300 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:51.944232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:51.946168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:51.947602 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-860826d9-db22-45ca-b6e4-6c262261d7ad tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1724 microversion: 2.20 time: 0.236329 Jul 04 08:09:51.948161 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 380/790] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:51 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:09:52.757067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-17c20744-8777-4df7-9b28-40b66acbc4fc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:52.757711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-17c20744-8777-4df7-9b28-40b66acbc4fc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:52.764759 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-17c20744-8777-4df7-9b28-40b66acbc4fc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:52.765193 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-17c20744-8777-4df7-9b28-40b66acbc4fc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:52.765995 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-17c20744-8777-4df7-9b28-40b66acbc4fc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:52.766415 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-17c20744-8777-4df7-9b28-40b66acbc4fc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:52.920361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-17c20744-8777-4df7-9b28-40b66acbc4fc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:52.929014 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-17c20744-8777-4df7-9b28-40b66acbc4fc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.176204 Jul 04 08:09:52.929598 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 411/791] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:52 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:52.967517 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:52.968168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:52.975222 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:52.975655 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:52.976398 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:52.976974 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:53.114959 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:53.123323 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:53.125040 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:53.126220 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-97c09621-ef15-411c-919a-8b343470503f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1724 microversion: 2.20 time: 0.162697 Jul 04 08:09:53.126774 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 381/792] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:52 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:53.282995 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4794549b-7ef5-4602-a3b8-3f495c09e2a2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c39389d-616c-409c-bc28-772c6f62c899"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:53.284071 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4794549b-7ef5-4602-a3b8-3f495c09e2a2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:53.290380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4794549b-7ef5-4602-a3b8-3f495c09e2a2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:53.290818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4794549b-7ef5-4602-a3b8-3f495c09e2a2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:53.291574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4794549b-7ef5-4602-a3b8-3f495c09e2a2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:53.292002 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4794549b-7ef5-4602-a3b8-3f495c09e2a2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:53.949444 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-569f2f91-1bc6-4807-847c-ad40e5ee37dc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:53.950082 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-569f2f91-1bc6-4807-847c-ad40e5ee37dc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:53.956713 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-569f2f91-1bc6-4807-847c-ad40e5ee37dc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:53.957160 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-569f2f91-1bc6-4807-847c-ad40e5ee37dc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:53.957943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-569f2f91-1bc6-4807-847c-ad40e5ee37dc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:53.958377 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-569f2f91-1bc6-4807-847c-ad40e5ee37dc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:54.104645 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-569f2f91-1bc6-4807-847c-ad40e5ee37dc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:54.114464 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-569f2f91-1bc6-4807-847c-ad40e5ee37dc tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.168899 Jul 04 08:09:54.115070 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 382/793] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:53 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:54.144991 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:54.145599 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:54.152162 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:54.152612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:54.153378 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:54.153843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:54.171146 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:54.223101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4794549b-7ef5-4602-a3b8-3f495c09e2a2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.944531 Jul 04 08:09:54.228353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 412/794] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:09:53 2022] POST /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments => generated 194 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:54.302029 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:54.310714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:54.312362 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:54.313513 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cecd989d-9796-4d04-ade2-3c45144f72b3 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1724 microversion: 2.20 time: 0.172516 Jul 04 08:09:54.314109 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 383/795] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:54 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:55.133577 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-947f7c66-7b7d-4f9a-a567-4994f59198ec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:55.134447 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-947f7c66-7b7d-4f9a-a567-4994f59198ec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:55.141080 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-947f7c66-7b7d-4f9a-a567-4994f59198ec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.141529 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-947f7c66-7b7d-4f9a-a567-4994f59198ec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.142324 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-947f7c66-7b7d-4f9a-a567-4994f59198ec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.142755 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-947f7c66-7b7d-4f9a-a567-4994f59198ec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.294511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-947f7c66-7b7d-4f9a-a567-4994f59198ec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:55.302898 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-947f7c66-7b7d-4f9a-a567-4994f59198ec tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.174052 Jul 04 08:09:55.303494 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 413/796] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:55 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:55.332743 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:55.333600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:55.342016 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.342757 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.343863 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.345049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.462168 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5138c533-b2ce-4bdc-addd-a32c52a78473 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:55.462671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5138c533-b2ce-4bdc-addd-a32c52a78473 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:55.469836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5138c533-b2ce-4bdc-addd-a32c52a78473 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.470279 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5138c533-b2ce-4bdc-addd-a32c52a78473 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.471071 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5138c533-b2ce-4bdc-addd-a32c52a78473 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.471702 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5138c533-b2ce-4bdc-addd-a32c52a78473 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.488531 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:55.498516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:55.500213 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:55.501524 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-486edd83-5f49-403e-b5e9-7ad4a7a48385 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1667 microversion: 2.20 time: 0.173120 Jul 04 08:09:55.502203 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 384/797] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:55 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1667 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:55.520555 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4fa6f080-5897-4b62-bb7a-69d303551b28 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ff06e0f-4216-4a85-b479-292223d1246a"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:55.521698 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4fa6f080-5897-4b62-bb7a-69d303551b28 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:55.528099 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4fa6f080-5897-4b62-bb7a-69d303551b28 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.528545 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4fa6f080-5897-4b62-bb7a-69d303551b28 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.529313 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4fa6f080-5897-4b62-bb7a-69d303551b28 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.529771 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4fa6f080-5897-4b62-bb7a-69d303551b28 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.562346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-5138c533-b2ce-4bdc-addd-a32c52a78473 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'services' on Instance uuid 3ab500b1-c48b-483c-978c-c34e45412a3a {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:09:55.644545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5138c533-b2ce-4bdc-addd-a32c52a78473 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments/17da7ad1-12a6-4f92-90e1-54767e6ada6a" status: 202 len: 0 microversion: 2.1 time: 0.187418 Jul 04 08:09:55.645214 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 414/798] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:09:55 2022] DELETE /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments/17da7ad1-12a6-4f92-90e1-54767e6ada6a => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:09:55.654411 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6dbea9cc-f15b-4322-8da7-d325cd89620e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:55.655511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6dbea9cc-f15b-4322-8da7-d325cd89620e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:55.663043 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dbea9cc-f15b-4322-8da7-d325cd89620e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.663567 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dbea9cc-f15b-4322-8da7-d325cd89620e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.664407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dbea9cc-f15b-4322-8da7-d325cd89620e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:55.664933 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dbea9cc-f15b-4322-8da7-d325cd89620e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:55.698732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6dbea9cc-f15b-4322-8da7-d325cd89620e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048710 Jul 04 08:09:55.702939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 415/799] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:09:55 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:55.868784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4fa6f080-5897-4b62-bb7a-69d303551b28 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.352361 Jul 04 08:09:55.869443 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 385/800] 10.222.0.43 () {62 vars in 1363 bytes} [Mon Jul 4 08:09:55 2022] POST /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/os-volume_attachments => generated 188 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 04 08:09:55.993658 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-725c85ba-f51d-4e00-a11e-4378f8f22685 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:55.994074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-725c85ba-f51d-4e00-a11e-4378f8f22685 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:56.001416 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-725c85ba-f51d-4e00-a11e-4378f8f22685 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.001888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-725c85ba-f51d-4e00-a11e-4378f8f22685 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.002986 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-725c85ba-f51d-4e00-a11e-4378f8f22685 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.003422 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-725c85ba-f51d-4e00-a11e-4378f8f22685 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.110847 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:09:56.220138 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-b3cfa486-6543-4979-9f91-43fddb49dfa5 req-4f209993-7151-4780-a8d0-8fae9b7c5109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb350cf-6a02-4ede-be92-0a7863bc0475", "name": "network-vif-unplugged", "status": "completed", "tag": "b71d89e6-8615-4c4e-8651-e32f4872be93"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:56.229220 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b3cfa486-6543-4979-9f91-43fddb49dfa5 req-4f209993-7151-4780-a8d0-8fae9b7c5109 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.229918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-b3cfa486-6543-4979-9f91-43fddb49dfa5 req-4f209993-7151-4780-a8d0-8fae9b7c5109 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.243266 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.compute.server_external_events [req-b3cfa486-6543-4979-9f91-43fddb49dfa5 req-4f209993-7151-4780-a8d0-8fae9b7c5109 service nova] Unable to find a host for instance 5eb350cf-6a02-4ede-be92-0a7863bc0475. Dropping event network-vif-unplugged {{(pid=117870) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 04 08:09:56.244564 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-b3cfa486-6543-4979-9f91-43fddb49dfa5 req-4f209993-7151-4780-a8d0-8fae9b7c5109 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028950 Jul 04 08:09:56.245571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 386/801] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 04 08:09:56.315295 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-725c85ba-f51d-4e00-a11e-4378f8f22685 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/os-volume_attachments/0ff06e0f-4216-4a85-b479-292223d1246a" status: 202 len: 0 microversion: 2.20 time: 0.326257 Jul 04 08:09:56.316177 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 416/802] 10.222.0.43 () {60 vars in 1456 bytes} [Mon Jul 4 08:09:55 2022] DELETE /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/os-volume_attachments/0ff06e0f-4216-4a85-b479-292223d1246a => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:09:56.321359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7b08a1ee-8577-495a-b9eb-acaccf0111b5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:56.321966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7b08a1ee-8577-495a-b9eb-acaccf0111b5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:56.329279 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b08a1ee-8577-495a-b9eb-acaccf0111b5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.329755 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b08a1ee-8577-495a-b9eb-acaccf0111b5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.330556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b08a1ee-8577-495a-b9eb-acaccf0111b5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.330984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7b08a1ee-8577-495a-b9eb-acaccf0111b5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.378626 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f07a7de7-8a2e-4a2f-b5b0-07de6c68f417 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:09:56.379174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f07a7de7-8a2e-4a2f-b5b0-07de6c68f417 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:56.386072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f07a7de7-8a2e-4a2f-b5b0-07de6c68f417 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.386523 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f07a7de7-8a2e-4a2f-b5b0-07de6c68f417 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.387309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f07a7de7-8a2e-4a2f-b5b0-07de6c68f417 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.387735 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f07a7de7-8a2e-4a2f-b5b0-07de6c68f417 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.475399 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7b08a1ee-8577-495a-b9eb-acaccf0111b5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:56.483251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7b08a1ee-8577-495a-b9eb-acaccf0111b5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.165956 Jul 04 08:09:56.483823 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 387/803] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:56 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:56.548340 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f07a7de7-8a2e-4a2f-b5b0-07de6c68f417 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "POST /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/action" status: 202 len: 0 microversion: 2.20 time: 0.174675 Jul 04 08:09:56.549073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 417/804] 10.222.0.43 () {62 vars in 1318 bytes} [Mon Jul 4 08:09:56 2022] POST /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:09:56.557504 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:56.558135 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:56.564472 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.564916 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.565856 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.566299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.708898 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:56.711339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-287a4937-c371-43a8-aeba-96ad114b0de1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:56.712621 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-287a4937-c371-43a8-aeba-96ad114b0de1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:56.718077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:56.719469 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-287a4937-c371-43a8-aeba-96ad114b0de1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.719921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-287a4937-c371-43a8-aeba-96ad114b0de1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.720696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-287a4937-c371-43a8-aeba-96ad114b0de1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:56.720830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:56.721462 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-287a4937-c371-43a8-aeba-96ad114b0de1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:56.722935 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1dd2dbee-5b76-4626-8726-a33f8294afbe tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1675 microversion: 2.20 time: 0.168643 Jul 04 08:09:56.723545 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 388/805] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:56 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:56.752037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-287a4937-c371-43a8-aeba-96ad114b0de1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Jul 04 08:09:56.752967 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 418/806] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:09:56 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:57.500187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e322df1-3a74-4781-9d77-5bc4d4a2d6ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:57.501096 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6e322df1-3a74-4781-9d77-5bc4d4a2d6ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:57.508491 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e322df1-3a74-4781-9d77-5bc4d4a2d6ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:57.508941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e322df1-3a74-4781-9d77-5bc4d4a2d6ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:57.509752 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e322df1-3a74-4781-9d77-5bc4d4a2d6ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:57.510216 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e322df1-3a74-4781-9d77-5bc4d4a2d6ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:57.650009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-6e322df1-3a74-4781-9d77-5bc4d4a2d6ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:57.657716 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6e322df1-3a74-4781-9d77-5bc4d4a2d6ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.161556 Jul 04 08:09:57.658280 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 389/807] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:57 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:57.743163 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:57.743749 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:57.750762 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:57.751212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:57.752040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:57.752765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:57.764339 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-04e536ff-5f5c-4720-8f77-5b891a16eac8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:57.766107 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-04e536ff-5f5c-4720-8f77-5b891a16eac8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:57.773389 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04e536ff-5f5c-4720-8f77-5b891a16eac8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:57.773389 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04e536ff-5f5c-4720-8f77-5b891a16eac8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:57.774262 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04e536ff-5f5c-4720-8f77-5b891a16eac8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:57.774685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04e536ff-5f5c-4720-8f77-5b891a16eac8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:57.811540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-04e536ff-5f5c-4720-8f77-5b891a16eac8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051130 Jul 04 08:09:57.812238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 390/808] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:09:57 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:57.888465 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:57.899161 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:57.900680 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:57.902241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-45f45a7d-9e52-4dc1-91d5-693c79928615 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1677 microversion: 2.20 time: 0.163090 Jul 04 08:09:57.902829 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 419/809] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:57 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:58.675951 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5566551c-06ea-439d-b7a2-7b893840c48a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:58.676538 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5566551c-06ea-439d-b7a2-7b893840c48a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:58.682997 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5566551c-06ea-439d-b7a2-7b893840c48a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:58.683440 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5566551c-06ea-439d-b7a2-7b893840c48a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:58.684228 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5566551c-06ea-439d-b7a2-7b893840c48a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:58.684704 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5566551c-06ea-439d-b7a2-7b893840c48a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:58.825019 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c96e219c-e781-4cbe-a3bd-2c712a048633 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:58.826048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c96e219c-e781-4cbe-a3bd-2c712a048633 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:58.833544 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c96e219c-e781-4cbe-a3bd-2c712a048633 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:58.834003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c96e219c-e781-4cbe-a3bd-2c712a048633 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:58.834815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c96e219c-e781-4cbe-a3bd-2c712a048633 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:58.835256 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c96e219c-e781-4cbe-a3bd-2c712a048633 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:58.868388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c96e219c-e781-4cbe-a3bd-2c712a048633 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047596 Jul 04 08:09:58.869288 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 420/810] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:09:58 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:09:58.921502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:58.922121 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:58.928775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:58.929212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:58.930004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:58.930426 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:59.002365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5566551c-06ea-439d-b7a2-7b893840c48a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:59.010530 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5566551c-06ea-439d-b7a2-7b893840c48a tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.339092 Jul 04 08:09:59.011091 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 391/811] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:09:58 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:09:59.080284 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:59.088864 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:59.090384 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:09:59.091524 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-da2a959b-2aec-46e6-8f45-c8a87d527957 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.174003 Jul 04 08:09:59.092093 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 421/812] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:09:58 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:09:59.881264 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ad1c2530-7d64-4da7-91ef-8a9b537f1ac1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:09:59.882157 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ad1c2530-7d64-4da7-91ef-8a9b537f1ac1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:09:59.889218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ad1c2530-7d64-4da7-91ef-8a9b537f1ac1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:59.889673 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ad1c2530-7d64-4da7-91ef-8a9b537f1ac1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:59.890774 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ad1c2530-7d64-4da7-91ef-8a9b537f1ac1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:09:59.891220 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ad1c2530-7d64-4da7-91ef-8a9b537f1ac1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:09:59.920998 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ad1c2530-7d64-4da7-91ef-8a9b537f1ac1 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Jul 04 08:09:59.921567 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 392/813] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:09:59 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:00.030033 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cacdd064-0964-4abc-80b8-9df9cbe41928 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:00.030781 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cacdd064-0964-4abc-80b8-9df9cbe41928 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:00.040025 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cacdd064-0964-4abc-80b8-9df9cbe41928 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:00.040601 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cacdd064-0964-4abc-80b8-9df9cbe41928 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:00.041596 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cacdd064-0964-4abc-80b8-9df9cbe41928 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:00.042194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cacdd064-0964-4abc-80b8-9df9cbe41928 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:00.113668 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:00.114349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:00.122577 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:00.123140 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:00.124195 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:00.124539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:00.180991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cacdd064-0964-4abc-80b8-9df9cbe41928 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:00.188843 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cacdd064-0964-4abc-80b8-9df9cbe41928 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.163978 Jul 04 08:10:00.189417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 422/814] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:00 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:00.269964 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:00.282881 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:00.284395 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:00.285565 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d8e88091-958b-4b29-a39c-e0a881ba1c38 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.176362 Jul 04 08:10:00.286164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 393/815] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:00 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:00.933558 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ac18384b-797a-4e15-8549-9d4ea2d4678c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:00.934454 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ac18384b-797a-4e15-8549-9d4ea2d4678c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:00.941110 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac18384b-797a-4e15-8549-9d4ea2d4678c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:00.941543 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac18384b-797a-4e15-8549-9d4ea2d4678c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:00.942470 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac18384b-797a-4e15-8549-9d4ea2d4678c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:00.942906 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac18384b-797a-4e15-8549-9d4ea2d4678c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:00.974825 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ac18384b-797a-4e15-8549-9d4ea2d4678c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Jul 04 08:10:00.975388 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 423/816] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:00 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:01.209711 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-426493bb-c5ff-4960-b70a-777d042be443 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:01.210261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-426493bb-c5ff-4960-b70a-777d042be443 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:01.219893 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-426493bb-c5ff-4960-b70a-777d042be443 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:01.220344 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-426493bb-c5ff-4960-b70a-777d042be443 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:01.221080 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-426493bb-c5ff-4960-b70a-777d042be443 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:01.221542 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-426493bb-c5ff-4960-b70a-777d042be443 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:01.303408 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:01.304166 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:01.311081 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:01.311521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:01.312321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:01.312768 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:01.367912 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-426493bb-c5ff-4960-b70a-777d042be443 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:01.376576 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-426493bb-c5ff-4960-b70a-777d042be443 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.172987 Jul 04 08:10:01.377314 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 394/817] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:01 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:01.452277 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:01.461553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:01.463012 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:01.464188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bd38f775-10aa-485c-9d58-6e444c02ea0b tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.164757 Jul 04 08:10:01.464766 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 424/818] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:01 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:01.987547 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0766a3d0-cc3c-4eb6-bd56-c1e262c755a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:01.988382 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0766a3d0-cc3c-4eb6-bd56-c1e262c755a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:01.995210 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0766a3d0-cc3c-4eb6-bd56-c1e262c755a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:01.995724 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0766a3d0-cc3c-4eb6-bd56-c1e262c755a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:01.996354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0766a3d0-cc3c-4eb6-bd56-c1e262c755a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:01.996759 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0766a3d0-cc3c-4eb6-bd56-c1e262c755a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:02.028890 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0766a3d0-cc3c-4eb6-bd56-c1e262c755a9 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Jul 04 08:10:02.029470 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 395/819] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:01 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:02.395557 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6401215e-bcad-4e97-bcef-2a58e62ec6db tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:02.396290 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6401215e-bcad-4e97-bcef-2a58e62ec6db tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:02.409504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6401215e-bcad-4e97-bcef-2a58e62ec6db tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:02.426562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6401215e-bcad-4e97-bcef-2a58e62ec6db tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:02.430384 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6401215e-bcad-4e97-bcef-2a58e62ec6db tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:02.430963 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6401215e-bcad-4e97-bcef-2a58e62ec6db tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:02.482303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:02.482935 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:02.490725 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:02.491818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:02.492323 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:02.492760 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:02.580309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6401215e-bcad-4e97-bcef-2a58e62ec6db tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:02.588500 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6401215e-bcad-4e97-bcef-2a58e62ec6db tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.197192 Jul 04 08:10:02.589102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 425/820] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:02 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:02.640891 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:02.649904 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:02.651476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:02.652600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f6ffd0ff-5342-43cf-ba61-f7b5874e1852 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.174308 Jul 04 08:10:02.653238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 396/821] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:02 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:10:02.885277 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-91614a0c-909a-474b-a7c4-abd9ca4c6bb2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:02.886335 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-91614a0c-909a-474b-a7c4-abd9ca4c6bb2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:02.893720 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-91614a0c-909a-474b-a7c4-abd9ca4c6bb2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:02.894591 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-91614a0c-909a-474b-a7c4-abd9ca4c6bb2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:02.895538 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-91614a0c-909a-474b-a7c4-abd9ca4c6bb2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:02.896301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-91614a0c-909a-474b-a7c4-abd9ca4c6bb2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:02.934895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-91614a0c-909a-474b-a7c4-abd9ca4c6bb2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053696 Jul 04 08:10:02.938473 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 426/822] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:02 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:02.946337 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-112eaa2b-959e-44e5-b694-ca953ba81d81 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:02.946829 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-112eaa2b-959e-44e5-b694-ca953ba81d81 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:02.953312 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-112eaa2b-959e-44e5-b694-ca953ba81d81 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:02.953751 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-112eaa2b-959e-44e5-b694-ca953ba81d81 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:02.954718 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-112eaa2b-959e-44e5-b694-ca953ba81d81 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:02.955341 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-112eaa2b-959e-44e5-b694-ca953ba81d81 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:02.993237 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-112eaa2b-959e-44e5-b694-ca953ba81d81 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/5c39389d-616c-409c-bc28-772c6f62c899" status: 200 len: 194 microversion: 2.1 time: 0.051082 Jul 04 08:10:02.994181 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 397/823] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Jul 4 08:10:02 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/5c39389d-616c-409c-bc28-772c6f62c899 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:03.041475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d8e4d98f-3cf3-4c64-8a12-54d81e448e6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:03.042644 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d8e4d98f-3cf3-4c64-8a12-54d81e448e6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:03.051848 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8e4d98f-3cf3-4c64-8a12-54d81e448e6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:03.052611 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8e4d98f-3cf3-4c64-8a12-54d81e448e6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:03.053496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8e4d98f-3cf3-4c64-8a12-54d81e448e6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:03.053968 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8e4d98f-3cf3-4c64-8a12-54d81e448e6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:03.096681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d8e4d98f-3cf3-4c64-8a12-54d81e448e6f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059683 Jul 04 08:10:03.097520 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 427/824] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:03 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:03.606759 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c0edb84e-aa8d-42e5-b9bc-e1742e4b1960 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:03.608100 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c0edb84e-aa8d-42e5-b9bc-e1742e4b1960 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:03.615712 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0edb84e-aa8d-42e5-b9bc-e1742e4b1960 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:03.616135 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0edb84e-aa8d-42e5-b9bc-e1742e4b1960 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:03.616941 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0edb84e-aa8d-42e5-b9bc-e1742e4b1960 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:03.617648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c0edb84e-aa8d-42e5-b9bc-e1742e4b1960 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:03.620721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:03.672841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:03.673588 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:03.680758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:03.681194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:03.682147 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:03.682587 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:03.803354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c0edb84e-aa8d-42e5-b9bc-e1742e4b1960 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:03.812001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c0edb84e-aa8d-42e5-b9bc-e1742e4b1960 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.209299 Jul 04 08:10:03.812756 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 398/825] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:03 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:03.847088 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:03.857920 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:03.859485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:03.860982 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0da25fd2-097a-4f4c-be0f-3f70ae14f567 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.192509 Jul 04 08:10:03.861570 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 428/826] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:03 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:03.947305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-282f1b0a-dd70-4c3b-81a1-d2206402a3b2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:03.947788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-282f1b0a-dd70-4c3b-81a1-d2206402a3b2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:03.954402 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-282f1b0a-dd70-4c3b-81a1-d2206402a3b2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:03.954847 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-282f1b0a-dd70-4c3b-81a1-d2206402a3b2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:03.955610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-282f1b0a-dd70-4c3b-81a1-d2206402a3b2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:03.956028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-282f1b0a-dd70-4c3b-81a1-d2206402a3b2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:03.984715 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-282f1b0a-dd70-4c3b-81a1-d2206402a3b2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:10:04.099419 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-282f1b0a-dd70-4c3b-81a1-d2206402a3b2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 204 len: 0 microversion: 2.1 time: 0.155674 Jul 04 08:10:04.104192 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 399/827] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:03 2022] DELETE /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:10:04.109901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-98f544f3-4e18-4dbc-a033-6b37439900c3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:04.110408 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-83f4ce9e-61bb-49a6-943e-3ca0ed0aba28 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:04.110857 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-98f544f3-4e18-4dbc-a033-6b37439900c3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:04.111828 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-83f4ce9e-61bb-49a6-943e-3ca0ed0aba28 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:04.118442 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83f4ce9e-61bb-49a6-943e-3ca0ed0aba28 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:04.118880 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98f544f3-4e18-4dbc-a033-6b37439900c3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:04.119007 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83f4ce9e-61bb-49a6-943e-3ca0ed0aba28 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:04.120049 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98f544f3-4e18-4dbc-a033-6b37439900c3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:04.120168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83f4ce9e-61bb-49a6-943e-3ca0ed0aba28 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:04.120168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-83f4ce9e-61bb-49a6-943e-3ca0ed0aba28 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:04.120814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98f544f3-4e18-4dbc-a033-6b37439900c3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:04.121369 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98f544f3-4e18-4dbc-a033-6b37439900c3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:04.155161 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-83f4ce9e-61bb-49a6-943e-3ca0ed0aba28 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049719 Jul 04 08:10:04.156088 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 400/828] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:04 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:04.311001 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-98f544f3-4e18-4dbc-a033-6b37439900c3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:04.319815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-98f544f3-4e18-4dbc-a033-6b37439900c3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.214598 Jul 04 08:10:04.320662 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 429/829] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:04 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:04.426739 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9000384a-146c-4513-9410-4bfb0b9ae42f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "170fa1a0-c807-4a19-a15b-6bfadb95c5d4"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:04.427845 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9000384a-146c-4513-9410-4bfb0b9ae42f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:04.436582 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9000384a-146c-4513-9410-4bfb0b9ae42f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:04.437322 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9000384a-146c-4513-9410-4bfb0b9ae42f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:04.438804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9000384a-146c-4513-9410-4bfb0b9ae42f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:04.439395 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9000384a-146c-4513-9410-4bfb0b9ae42f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:04.830018 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a26804e1-9f29-4937-86a3-d359c74753c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:04.830663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a26804e1-9f29-4937-86a3-d359c74753c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:04.837465 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a26804e1-9f29-4937-86a3-d359c74753c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:04.837947 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a26804e1-9f29-4937-86a3-d359c74753c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:04.838709 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a26804e1-9f29-4937-86a3-d359c74753c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:04.839140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a26804e1-9f29-4937-86a3-d359c74753c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:04.861417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=92,nova_cell1:UPDATE=5 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:04.982575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a26804e1-9f29-4937-86a3-d359c74753c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:04.995625 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a26804e1-9f29-4937-86a3-d359c74753c7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.169761 Jul 04 08:10:04.996220 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 430/830] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:04 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:05.000798 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:05.001391 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:05.007881 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:05.008317 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:05.009201 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:05.009652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:05.158765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:05.178797 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:05.180896 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:05.182445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-67c2a14c-feed-4c65-8a21-29d5ccd3d294 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.185234 Jul 04 08:10:05.183122 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 431/831] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:04 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:05.194253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1a7b5520-70ff-48e0-89b6-b104d1d7e3f6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:05.195242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1a7b5520-70ff-48e0-89b6-b104d1d7e3f6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:05.201933 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a7b5520-70ff-48e0-89b6-b104d1d7e3f6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:05.202378 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a7b5520-70ff-48e0-89b6-b104d1d7e3f6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:05.203285 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a7b5520-70ff-48e0-89b6-b104d1d7e3f6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:05.203701 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a7b5520-70ff-48e0-89b6-b104d1d7e3f6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:05.237510 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1a7b5520-70ff-48e0-89b6-b104d1d7e3f6 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047326 Jul 04 08:10:05.238146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 432/832] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:05 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:05.406792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3f62357f-24a6-46c4-9fc7-22a676cb4252 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:05.407662 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3f62357f-24a6-46c4-9fc7-22a676cb4252 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:05.414650 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3f62357f-24a6-46c4-9fc7-22a676cb4252 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:05.415224 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3f62357f-24a6-46c4-9fc7-22a676cb4252 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:05.416060 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3f62357f-24a6-46c4-9fc7-22a676cb4252 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:05.416599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3f62357f-24a6-46c4-9fc7-22a676cb4252 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:05.559352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3f62357f-24a6-46c4-9fc7-22a676cb4252 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:05.570075 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3f62357f-24a6-46c4-9fc7-22a676cb4252 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.167281 Jul 04 08:10:05.577832 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 433/833] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:05 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:06.013936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7c84842b-f4cc-4255-b031-138137f88d97 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:06.014645 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7c84842b-f4cc-4255-b031-138137f88d97 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:06.031106 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c84842b-f4cc-4255-b031-138137f88d97 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:06.031711 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c84842b-f4cc-4255-b031-138137f88d97 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:06.032508 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c84842b-f4cc-4255-b031-138137f88d97 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:06.032935 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c84842b-f4cc-4255-b031-138137f88d97 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:06.173511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7c84842b-f4cc-4255-b031-138137f88d97 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:06.182920 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7c84842b-f4cc-4255-b031-138137f88d97 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.172946 Jul 04 08:10:06.183517 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 434/834] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:06 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:06.203915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:06.204517 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:06.213352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:06.213819 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:06.214584 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:06.215010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:06.384540 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:06.394155 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:06.395904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:06.397179 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d6134ed6-b5c2-4c51-85f9-08af64547219 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.198610 Jul 04 08:10:06.398058 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 435/835] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:06 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:06.414691 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0611c5a-3b23-475e-982a-9a5a11c6391f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:06.416122 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a0611c5a-3b23-475e-982a-9a5a11c6391f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:06.422989 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0611c5a-3b23-475e-982a-9a5a11c6391f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:06.423430 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0611c5a-3b23-475e-982a-9a5a11c6391f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:06.424198 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0611c5a-3b23-475e-982a-9a5a11c6391f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:06.424623 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0611c5a-3b23-475e-982a-9a5a11c6391f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:06.460239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a0611c5a-3b23-475e-982a-9a5a11c6391f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050686 Jul 04 08:10:06.460884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 436/836] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:06 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:06.465397 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-155d7e35-288d-4426-8eda-0e1ec2254246 req-b80747a0-2f2e-4f69-9eea-1d1630d358c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bf7886-bd99-4926-bb03-78d6488963f8", "name": "network-vif-unplugged", "status": "completed", "tag": "7b293845-76c3-49eb-ad43-17b180aeee72"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:06.473934 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-155d7e35-288d-4426-8eda-0e1ec2254246 req-b80747a0-2f2e-4f69-9eea-1d1630d358c3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:06.474369 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-155d7e35-288d-4426-8eda-0e1ec2254246 req-b80747a0-2f2e-4f69-9eea-1d1630d358c3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:06.486948 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-155d7e35-288d-4426-8eda-0e1ec2254246 req-b80747a0-2f2e-4f69-9eea-1d1630d358c3 service nova] Creating event network-vif-unplugged:7b293845-76c3-49eb-ad43-17b180aeee72 for instance 52bf7886-bd99-4926-bb03-78d6488963f8 on hv-cinder-79760 Jul 04 08:10:06.492222 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-155d7e35-288d-4426-8eda-0e1ec2254246 req-b80747a0-2f2e-4f69-9eea-1d1630d358c3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030104 Jul 04 08:10:06.492827 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 437/837] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:06.591602 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-29404d34-72ff-47b9-aa83-24443e53663f tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:06.592431 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-29404d34-72ff-47b9-aa83-24443e53663f tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:06.604288 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29404d34-72ff-47b9-aa83-24443e53663f tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:06.604734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29404d34-72ff-47b9-aa83-24443e53663f tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:06.606716 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29404d34-72ff-47b9-aa83-24443e53663f tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:06.607254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29404d34-72ff-47b9-aa83-24443e53663f tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:06.756404 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-29404d34-72ff-47b9-aa83-24443e53663f tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:06.764302 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-29404d34-72ff-47b9-aa83-24443e53663f tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.177330 Jul 04 08:10:06.764884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 438/838] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:06 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:07.201805 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-331ba778-30de-4337-9648-30300d3dfb44 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:07.202516 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-331ba778-30de-4337-9648-30300d3dfb44 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:07.211667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-331ba778-30de-4337-9648-30300d3dfb44 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:07.212115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-331ba778-30de-4337-9648-30300d3dfb44 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:07.212981 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-331ba778-30de-4337-9648-30300d3dfb44 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:07.214321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-331ba778-30de-4337-9648-30300d3dfb44 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:07.357866 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-331ba778-30de-4337-9648-30300d3dfb44 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:07.366604 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-331ba778-30de-4337-9648-30300d3dfb44 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.169676 Jul 04 08:10:07.367998 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 439/839] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:07 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:07.415830 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:07.416721 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:07.423308 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:07.423754 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:07.424525 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:07.424956 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:07.585956 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:07.594747 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:07.596254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:07.597648 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5daf9c17-9507-46e0-8015-0d74558c9192 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.185626 Jul 04 08:10:07.598539 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 440/840] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:07 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:10:07.603174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5eb61af4-9ab3-4729-83f8-7f0bec1e0d4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:07.604152 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5eb61af4-9ab3-4729-83f8-7f0bec1e0d4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:07.611305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5eb61af4-9ab3-4729-83f8-7f0bec1e0d4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:07.611754 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5eb61af4-9ab3-4729-83f8-7f0bec1e0d4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:07.612532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5eb61af4-9ab3-4729-83f8-7f0bec1e0d4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:07.612946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5eb61af4-9ab3-4729-83f8-7f0bec1e0d4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:07.646338 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5eb61af4-9ab3-4729-83f8-7f0bec1e0d4e tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Jul 04 08:10:07.646936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 441/841] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:07 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:07.781762 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-40106830-f948-4a51-a60b-fd69d2b7778d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:07.782363 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-40106830-f948-4a51-a60b-fd69d2b7778d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:07.790433 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-40106830-f948-4a51-a60b-fd69d2b7778d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:07.791049 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-40106830-f948-4a51-a60b-fd69d2b7778d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:07.792188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-40106830-f948-4a51-a60b-fd69d2b7778d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:07.792748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-40106830-f948-4a51-a60b-fd69d2b7778d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:07.939326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-40106830-f948-4a51-a60b-fd69d2b7778d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:07.947376 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-40106830-f948-4a51-a60b-fd69d2b7778d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.169567 Jul 04 08:10:07.948189 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 442/842] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:07 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:08.384815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-21d92d46-e05a-4711-b3db-cf1f8040462f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:08.385709 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-21d92d46-e05a-4711-b3db-cf1f8040462f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:08.393000 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-21d92d46-e05a-4711-b3db-cf1f8040462f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:08.393444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-21d92d46-e05a-4711-b3db-cf1f8040462f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:08.394750 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-21d92d46-e05a-4711-b3db-cf1f8040462f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:08.394750 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-21d92d46-e05a-4711-b3db-cf1f8040462f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:08.546068 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-21d92d46-e05a-4711-b3db-cf1f8040462f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:08.554611 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-21d92d46-e05a-4711-b3db-cf1f8040462f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.173723 Jul 04 08:10:08.555211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 443/843] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:08 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:08.618686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:08.619291 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:08.625992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:08.626434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:08.627207 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:08.627983 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:08.772493 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:08.780965 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:08.783079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:08.784249 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-485d7669-dc3e-482a-a2a8-3c81603b4a3e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.170575 Jul 04 08:10:08.784813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 444/844] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:08 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:10:08.798088 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f8c5ffbb-aa77-479e-ad7f-931cd52ff949 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:08.799082 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f8c5ffbb-aa77-479e-ad7f-931cd52ff949 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:08.805579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8c5ffbb-aa77-479e-ad7f-931cd52ff949 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:08.806050 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8c5ffbb-aa77-479e-ad7f-931cd52ff949 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:08.806812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8c5ffbb-aa77-479e-ad7f-931cd52ff949 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:08.807280 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8c5ffbb-aa77-479e-ad7f-931cd52ff949 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:08.852656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f8c5ffbb-aa77-479e-ad7f-931cd52ff949 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059239 Jul 04 08:10:08.854491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 445/845] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:08 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:08.966407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2fe90915-544a-45e8-8b94-2870e31b5224 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:08.967035 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2fe90915-544a-45e8-8b94-2870e31b5224 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:08.974433 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fe90915-544a-45e8-8b94-2870e31b5224 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:08.974872 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fe90915-544a-45e8-8b94-2870e31b5224 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:08.975620 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fe90915-544a-45e8-8b94-2870e31b5224 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:08.976063 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fe90915-544a-45e8-8b94-2870e31b5224 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:09.128708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2fe90915-544a-45e8-8b94-2870e31b5224 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:09.138004 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2fe90915-544a-45e8-8b94-2870e31b5224 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.175317 Jul 04 08:10:09.138706 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 446/846] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:08 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:09.574753 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-217118be-4ba8-4b5c-afab-fc5798528bf6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:09.575498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-217118be-4ba8-4b5c-afab-fc5798528bf6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:09.582851 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-217118be-4ba8-4b5c-afab-fc5798528bf6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:09.583259 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-217118be-4ba8-4b5c-afab-fc5798528bf6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:09.584093 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-217118be-4ba8-4b5c-afab-fc5798528bf6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:09.584517 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-217118be-4ba8-4b5c-afab-fc5798528bf6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:09.739299 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-217118be-4ba8-4b5c-afab-fc5798528bf6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:09.742929 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:09.747963 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-217118be-4ba8-4b5c-afab-fc5798528bf6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.177209 Jul 04 08:10:09.748542 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 447/847] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:09 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:09.803498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:09.804095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:09.811553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:09.812010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:09.813118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:09.813427 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:09.968115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:09.976784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:09.978317 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:09.979468 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8363c511-b7a3-4cf0-a763-00f9cd17659e tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.180172 Jul 04 08:10:09.980075 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 448/848] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:09 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:09.984569 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e41c986f-85a5-440b-81e3-e92c37b9de4a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:09.985538 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e41c986f-85a5-440b-81e3-e92c37b9de4a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:09.991572 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e41c986f-85a5-440b-81e3-e92c37b9de4a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:09.992073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e41c986f-85a5-440b-81e3-e92c37b9de4a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:09.992841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e41c986f-85a5-440b-81e3-e92c37b9de4a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:09.993270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e41c986f-85a5-440b-81e3-e92c37b9de4a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:10.030074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e41c986f-85a5-440b-81e3-e92c37b9de4a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048899 Jul 04 08:10:10.030857 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 449/849] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:09 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:10.160641 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-94da586c-6835-4ec9-9f0c-b1d88a2ca368 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:10.161274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-94da586c-6835-4ec9-9f0c-b1d88a2ca368 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:10.170490 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-94da586c-6835-4ec9-9f0c-b1d88a2ca368 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:10.170923 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-94da586c-6835-4ec9-9f0c-b1d88a2ca368 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:10.171730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-94da586c-6835-4ec9-9f0c-b1d88a2ca368 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:10.172154 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-94da586c-6835-4ec9-9f0c-b1d88a2ca368 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:10.323915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-94da586c-6835-4ec9-9f0c-b1d88a2ca368 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:10.332716 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-94da586c-6835-4ec9-9f0c-b1d88a2ca368 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.177270 Jul 04 08:10:10.342499 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 450/850] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:10 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:10.771668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e6fe7cbc-6f50-45ac-9ffd-7b3335ddebf5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:10.772801 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e6fe7cbc-6f50-45ac-9ffd-7b3335ddebf5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:10.780251 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6fe7cbc-6f50-45ac-9ffd-7b3335ddebf5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:10.780744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6fe7cbc-6f50-45ac-9ffd-7b3335ddebf5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:10.781653 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6fe7cbc-6f50-45ac-9ffd-7b3335ddebf5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:10.782195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6fe7cbc-6f50-45ac-9ffd-7b3335ddebf5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:10.959345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e6fe7cbc-6f50-45ac-9ffd-7b3335ddebf5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:10.966525 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e6fe7cbc-6f50-45ac-9ffd-7b3335ddebf5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.203972 Jul 04 08:10:10.967136 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 451/851] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:10 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:10.999560 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:11.000176 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:11.007094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:11.007541 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:11.008315 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:11.008751 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:11.156137 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:11.164633 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:11.166289 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:11.167450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c36d26cc-b65f-4ad4-91e3-f40b3f90e069 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.171942 Jul 04 08:10:11.169647 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 452/852] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:10 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:10:11.173574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-601829f7-93c3-48ae-a490-98dd5d927248 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:11.174848 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-601829f7-93c3-48ae-a490-98dd5d927248 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:11.181664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-601829f7-93c3-48ae-a490-98dd5d927248 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:11.182444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-601829f7-93c3-48ae-a490-98dd5d927248 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:11.183436 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-601829f7-93c3-48ae-a490-98dd5d927248 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:11.183864 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-601829f7-93c3-48ae-a490-98dd5d927248 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:11.215835 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-601829f7-93c3-48ae-a490-98dd5d927248 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046467 Jul 04 08:10:11.216449 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 453/853] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:11 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:11.350684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-36e46056-51cf-405d-8a84-a82b8420440b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:11.351289 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-36e46056-51cf-405d-8a84-a82b8420440b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:11.358160 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-36e46056-51cf-405d-8a84-a82b8420440b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:11.358606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-36e46056-51cf-405d-8a84-a82b8420440b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:11.359532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-36e46056-51cf-405d-8a84-a82b8420440b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:11.360101 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-36e46056-51cf-405d-8a84-a82b8420440b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:11.524899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-36e46056-51cf-405d-8a84-a82b8420440b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:11.533562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-36e46056-51cf-405d-8a84-a82b8420440b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.187086 Jul 04 08:10:11.534321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 454/854] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:11 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:11.987100 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9b8d90ba-0c7b-4a53-bb18-932d2a8ab281 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:11.987822 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9b8d90ba-0c7b-4a53-bb18-932d2a8ab281 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:11.990130 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:11.995829 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b8d90ba-0c7b-4a53-bb18-932d2a8ab281 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:11.996256 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b8d90ba-0c7b-4a53-bb18-932d2a8ab281 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:11.997028 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b8d90ba-0c7b-4a53-bb18-932d2a8ab281 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:11.997452 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b8d90ba-0c7b-4a53-bb18-932d2a8ab281 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:12.313498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9b8d90ba-0c7b-4a53-bb18-932d2a8ab281 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:12.323484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9b8d90ba-0c7b-4a53-bb18-932d2a8ab281 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.341365 Jul 04 08:10:12.324368 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 455/855] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:11 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:12.329282 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:12.329876 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:12.336736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:12.337178 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:12.338524 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:12.339109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:12.477035 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:12.493056 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:12.493056 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:12.493056 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-80e349e2-7f03-4521-8a42-447f4768a171 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.167148 Jul 04 08:10:12.495040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 456/856] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:12 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:12.498106 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-00129a3f-bcda-4c70-af2a-6af8fc3503bf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:12.499203 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-00129a3f-bcda-4c70-af2a-6af8fc3503bf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:12.508071 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-00129a3f-bcda-4c70-af2a-6af8fc3503bf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:12.508559 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-00129a3f-bcda-4c70-af2a-6af8fc3503bf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:12.509293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-00129a3f-bcda-4c70-af2a-6af8fc3503bf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:12.509755 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-00129a3f-bcda-4c70-af2a-6af8fc3503bf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:12.540803 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-00129a3f-bcda-4c70-af2a-6af8fc3503bf tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046703 Jul 04 08:10:12.541364 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 457/857] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:12 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:12.554481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f2c1bcf7-61d0-4a26-991b-1aa4dd6156de tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:12.555079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f2c1bcf7-61d0-4a26-991b-1aa4dd6156de tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:12.561065 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2c1bcf7-61d0-4a26-991b-1aa4dd6156de tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:12.561509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2c1bcf7-61d0-4a26-991b-1aa4dd6156de tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:12.562454 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2c1bcf7-61d0-4a26-991b-1aa4dd6156de tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:12.563145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2c1bcf7-61d0-4a26-991b-1aa4dd6156de tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:12.708136 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f2c1bcf7-61d0-4a26-991b-1aa4dd6156de tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:12.719296 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f2c1bcf7-61d0-4a26-991b-1aa4dd6156de tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.168093 Jul 04 08:10:12.720125 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 458/858] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:12 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:13.341433 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1d0d25c4-d08e-429b-bded-c4089c6ba7f5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:13.342163 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1d0d25c4-d08e-429b-bded-c4089c6ba7f5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:13.350498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1d0d25c4-d08e-429b-bded-c4089c6ba7f5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:13.350952 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1d0d25c4-d08e-429b-bded-c4089c6ba7f5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:13.351702 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1d0d25c4-d08e-429b-bded-c4089c6ba7f5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:13.352187 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1d0d25c4-d08e-429b-bded-c4089c6ba7f5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:13.508120 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9000384a-146c-4513-9410-4bfb0b9ae42f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "POST /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.085252 Jul 04 08:10:13.508778 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 401/859] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:10:04 2022] POST /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments => generated 194 bytes in 9087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:13.511885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1d0d25c4-d08e-429b-bded-c4089c6ba7f5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:13.513947 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:13.514638 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:13.520736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1d0d25c4-d08e-429b-bded-c4089c6ba7f5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.183205 Jul 04 08:10:13.521526 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:13.521854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 459/860] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:13 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:13.522015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:13.522784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:13.523203 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:13.554879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-78777deb-f9ca-4113-8ede-f232a8422b71 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:13.556568 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-78777deb-f9ca-4113-8ede-f232a8422b71 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:13.562994 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-78777deb-f9ca-4113-8ede-f232a8422b71 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:13.563438 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-78777deb-f9ca-4113-8ede-f232a8422b71 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:13.564205 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-78777deb-f9ca-4113-8ede-f232a8422b71 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:13.564629 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-78777deb-f9ca-4113-8ede-f232a8422b71 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:13.599548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-78777deb-f9ca-4113-8ede-f232a8422b71 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049837 Jul 04 08:10:13.600045 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 460/861] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:13 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:13.674090 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:13.686998 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:13.689069 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:13.690931 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-33d437c0-9c05-40ef-9cc8-6ed744036105 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.180829 Jul 04 08:10:13.691768 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 402/862] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:13 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:13.739027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ba340130-f8f1-40aa-ad81-c3b78eb59f45 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:13.739910 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ba340130-f8f1-40aa-ad81-c3b78eb59f45 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:13.748514 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ba340130-f8f1-40aa-ad81-c3b78eb59f45 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:13.749088 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ba340130-f8f1-40aa-ad81-c3b78eb59f45 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:13.750079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ba340130-f8f1-40aa-ad81-c3b78eb59f45 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:13.750507 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ba340130-f8f1-40aa-ad81-c3b78eb59f45 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:13.891631 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ba340130-f8f1-40aa-ad81-c3b78eb59f45 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:13.899550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ba340130-f8f1-40aa-ad81-c3b78eb59f45 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.166086 Jul 04 08:10:13.900105 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 461/863] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:13 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:14.547388 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b2d2114f-80ff-4058-9f6c-73406215e7d5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:14.548202 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b2d2114f-80ff-4058-9f6c-73406215e7d5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:14.555763 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b2d2114f-80ff-4058-9f6c-73406215e7d5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.556205 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b2d2114f-80ff-4058-9f6c-73406215e7d5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.556961 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b2d2114f-80ff-4058-9f6c-73406215e7d5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.557365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b2d2114f-80ff-4058-9f6c-73406215e7d5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.682606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-251d8cdf-33b2-43c4-965a-5652a25cb089 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:14.683585 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-251d8cdf-33b2-43c4-965a-5652a25cb089 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:14.690200 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-251d8cdf-33b2-43c4-965a-5652a25cb089 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.690637 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-251d8cdf-33b2-43c4-965a-5652a25cb089 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.691385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-251d8cdf-33b2-43c4-965a-5652a25cb089 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.691807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-251d8cdf-33b2-43c4-965a-5652a25cb089 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.706255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b2d2114f-80ff-4058-9f6c-73406215e7d5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:14.715061 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b2d2114f-80ff-4058-9f6c-73406215e7d5 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1569 microversion: 2.1 time: 0.171546 Jul 04 08:10:14.715820 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 403/864] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:14 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:14.720932 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:14.721960 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:14.727458 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-251d8cdf-33b2-43c4-965a-5652a25cb089 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120035 Jul 04 08:10:14.728557 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 462/865] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:14 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:10:14.733356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.734081 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.735636 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.736266 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.740461 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c115621c-3870-4a23-9305-a4a1ccc5e685 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:14.741295 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c115621c-3870-4a23-9305-a4a1ccc5e685 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:14.748969 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c115621c-3870-4a23-9305-a4a1ccc5e685 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.749581 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c115621c-3870-4a23-9305-a4a1ccc5e685 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.750301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c115621c-3870-4a23-9305-a4a1ccc5e685 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.750727 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c115621c-3870-4a23-9305-a4a1ccc5e685 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.808508 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:14.841350 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c115621c-3870-4a23-9305-a4a1ccc5e685 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "POST /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8/action" status: 202 len: 0 microversion: 2.1 time: 0.111400 Jul 04 08:10:14.841959 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 463/866] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:10:14 2022] POST /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 08:10:14.852629 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-71716c5f-b927-4e94-8eca-e9ef5cf3a423 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:14.854372 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-71716c5f-b927-4e94-8eca-e9ef5cf3a423 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:14.862618 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-71716c5f-b927-4e94-8eca-e9ef5cf3a423 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.863084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-71716c5f-b927-4e94-8eca-e9ef5cf3a423 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.863926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-71716c5f-b927-4e94-8eca-e9ef5cf3a423 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.864406 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-71716c5f-b927-4e94-8eca-e9ef5cf3a423 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.935004 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:14.945227 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:14.946789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:14.948256 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bdd0c45a-7a1e-4b8c-a4a4-0ef109d16ff4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.231414 Jul 04 08:10:14.948834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 404/867] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:14 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:14.956690 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9d2cdb33-e406-4b6f-9798-ccef48b4f760 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:14.957274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9d2cdb33-e406-4b6f-9798-ccef48b4f760 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:14.965525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9d2cdb33-e406-4b6f-9798-ccef48b4f760 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.965525 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9d2cdb33-e406-4b6f-9798-ccef48b4f760 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:14.966225 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9d2cdb33-e406-4b6f-9798-ccef48b4f760 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:14.966659 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9d2cdb33-e406-4b6f-9798-ccef48b4f760 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:15.160795 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9d2cdb33-e406-4b6f-9798-ccef48b4f760 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:15.173743 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9d2cdb33-e406-4b6f-9798-ccef48b4f760 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1580 microversion: 2.1 time: 0.221318 Jul 04 08:10:15.175373 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 405/868] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:14 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1580 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:15.332518 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-71716c5f-b927-4e94-8eca-e9ef5cf3a423 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:15.340981 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-71716c5f-b927-4e94-8eca-e9ef5cf3a423 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1577 microversion: 2.1 time: 0.494911 Jul 04 08:10:15.341954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 464/869] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:14 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1577 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:15.740934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9c9817a5-0d92-41b1-aed0-81cb77753fec tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:15.742153 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9c9817a5-0d92-41b1-aed0-81cb77753fec tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:15.751210 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c9817a5-0d92-41b1-aed0-81cb77753fec tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:15.751952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c9817a5-0d92-41b1-aed0-81cb77753fec tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:15.753196 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c9817a5-0d92-41b1-aed0-81cb77753fec tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:15.753728 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9c9817a5-0d92-41b1-aed0-81cb77753fec tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:15.792010 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9c9817a5-0d92-41b1-aed0-81cb77753fec tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055094 Jul 04 08:10:15.797342 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 406/870] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:15 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 08:10:15.875018 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5d00eab9-ee84-4ae0-964d-e3e907bc927f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:15.876234 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5d00eab9-ee84-4ae0-964d-e3e907bc927f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:15.883345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d00eab9-ee84-4ae0-964d-e3e907bc927f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:15.883780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d00eab9-ee84-4ae0-964d-e3e907bc927f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:15.884751 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d00eab9-ee84-4ae0-964d-e3e907bc927f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:15.885169 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d00eab9-ee84-4ae0-964d-e3e907bc927f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:15.914003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5d00eab9-ee84-4ae0-964d-e3e907bc927f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:10:15.967119 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:15.967990 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:15.974570 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:15.975118 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:15.975984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:15.976631 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:16.052963 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5d00eab9-ee84-4ae0-964d-e3e907bc927f tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 204 len: 0 microversion: 2.1 time: 0.182206 Jul 04 08:10:16.054299 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 465/871] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:15 2022] DELETE /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:10:16.065444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-85670ecb-8d9a-4196-9093-1142f1d27998 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:16.067295 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-85670ecb-8d9a-4196-9093-1142f1d27998 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:16.080063 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85670ecb-8d9a-4196-9093-1142f1d27998 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:16.080980 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85670ecb-8d9a-4196-9093-1142f1d27998 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:16.082106 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85670ecb-8d9a-4196-9093-1142f1d27998 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:16.082822 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85670ecb-8d9a-4196-9093-1142f1d27998 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:16.278681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-85670ecb-8d9a-4196-9093-1142f1d27998 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:16.289390 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-85670ecb-8d9a-4196-9093-1142f1d27998 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1688 microversion: 2.1 time: 0.229618 Jul 04 08:10:16.291340 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 466/872] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:16 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:16.297844 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ed3c1d28-c479-4d45-9be9-da1e4b8166a0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:16.298532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ed3c1d28-c479-4d45-9be9-da1e4b8166a0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:16.308812 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ed3c1d28-c479-4d45-9be9-da1e4b8166a0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:16.309441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ed3c1d28-c479-4d45-9be9-da1e4b8166a0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:16.311223 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ed3c1d28-c479-4d45-9be9-da1e4b8166a0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:16.312006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ed3c1d28-c479-4d45-9be9-da1e4b8166a0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:16.393936 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:16.413483 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ed3c1d28-c479-4d45-9be9-da1e4b8166a0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:16.424138 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ed3c1d28-c479-4d45-9be9-da1e4b8166a0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1512 microversion: 2.1 time: 0.130419 Jul 04 08:10:16.425351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 467/873] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:16 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1512 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:16.432508 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-989a2237-6d55-4b9f-a7ac-ef8a1b371275 req-7112c74a-c0ea-498f-b005-f77fac1b0072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cf097eb-a2e5-4ce3-b0d9-1104988fe661", "name": "network-vif-deleted", "tag": "664da2ec-3174-44ad-9296-0f70c9630416"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:16.433011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:16.435155 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:16.436649 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8b4846d8-a3d7-4e66-94ff-1f9516e14c72 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.473511 Jul 04 08:10:16.445681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-989a2237-6d55-4b9f-a7ac-ef8a1b371275 req-7112c74a-c0ea-498f-b005-f77fac1b0072 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:16.445681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-989a2237-6d55-4b9f-a7ac-ef8a1b371275 req-7112c74a-c0ea-498f-b005-f77fac1b0072 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:16.448203 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 407/874] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:15 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:10:16.453511 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-054740b0-5611-48d0-99ef-638592122113 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:16.454431 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-054740b0-5611-48d0-99ef-638592122113 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:16.462481 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-989a2237-6d55-4b9f-a7ac-ef8a1b371275 req-7112c74a-c0ea-498f-b005-f77fac1b0072 service nova] Creating event network-vif-deleted:664da2ec-3174-44ad-9296-0f70c9630416 for instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 on hv-cinder-79760 Jul 04 08:10:16.469759 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-989a2237-6d55-4b9f-a7ac-ef8a1b371275 req-7112c74a-c0ea-498f-b005-f77fac1b0072 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041684 Jul 04 08:10:16.469759 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 468/875] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:16.474057 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-054740b0-5611-48d0-99ef-638592122113 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:16.474505 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-054740b0-5611-48d0-99ef-638592122113 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:16.475424 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-054740b0-5611-48d0-99ef-638592122113 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:16.475947 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-054740b0-5611-48d0-99ef-638592122113 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:16.645232 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-054740b0-5611-48d0-99ef-638592122113 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:16.654453 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-054740b0-5611-48d0-99ef-638592122113 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1519 microversion: 2.1 time: 0.204962 Jul 04 08:10:16.655104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 408/876] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:16 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:17.309565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-62707fe9-3dd0-4bfe-bcfd-3364ec195c0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:17.310433 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-62707fe9-3dd0-4bfe-bcfd-3364ec195c0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:17.317946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62707fe9-3dd0-4bfe-bcfd-3364ec195c0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:17.318575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62707fe9-3dd0-4bfe-bcfd-3364ec195c0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:17.324848 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62707fe9-3dd0-4bfe-bcfd-3364ec195c0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:17.324848 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62707fe9-3dd0-4bfe-bcfd-3364ec195c0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:17.443411 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cc7d3cbd-67ba-4dbe-aa5c-811c79da3488 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:17.444054 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-cc7d3cbd-67ba-4dbe-aa5c-811c79da3488 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:17.452556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cc7d3cbd-67ba-4dbe-aa5c-811c79da3488 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:17.452990 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cc7d3cbd-67ba-4dbe-aa5c-811c79da3488 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:17.453847 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cc7d3cbd-67ba-4dbe-aa5c-811c79da3488 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:17.455226 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-cc7d3cbd-67ba-4dbe-aa5c-811c79da3488 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:17.471652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-62707fe9-3dd0-4bfe-bcfd-3364ec195c0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:17.480832 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-62707fe9-3dd0-4bfe-bcfd-3364ec195c0d tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1688 microversion: 2.1 time: 0.176005 Jul 04 08:10:17.488308 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 469/877] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:17 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1688 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:17.496484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:17.497569 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:17.510463 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:17.511246 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:17.512660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:17.513452 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:17.524325 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-cc7d3cbd-67ba-4dbe-aa5c-811c79da3488 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:17.532775 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cc7d3cbd-67ba-4dbe-aa5c-811c79da3488 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1512 microversion: 2.1 time: 0.093774 Jul 04 08:10:17.533371 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 409/878] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:17 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1512 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:17.657014 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:17.666377 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:17.667876 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:17.669042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9b1422ac-ebb4-4414-8c88-dc50bffe8df2 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.186226 Jul 04 08:10:17.669612 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 470/879] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:17 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:17.680198 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-3f2d83fc-77d8-4a9d-a350-ba8719893f4e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:17.681028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-3f2d83fc-77d8-4a9d-a350-ba8719893f4e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:17.687395 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f2d83fc-77d8-4a9d-a350-ba8719893f4e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:17.687845 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f2d83fc-77d8-4a9d-a350-ba8719893f4e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:17.688964 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f2d83fc-77d8-4a9d-a350-ba8719893f4e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:17.689585 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-3f2d83fc-77d8-4a9d-a350-ba8719893f4e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:17.829696 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-3f2d83fc-77d8-4a9d-a350-ba8719893f4e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:17.838547 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-3f2d83fc-77d8-4a9d-a350-ba8719893f4e tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1519 microversion: 2.1 time: 0.162349 Jul 04 08:10:17.839435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 410/880] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:17 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:18.330315 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-3b7e69f3-7dc6-456a-aaed-fcb4019975c0 req-f24ae32e-d74c-4e40-9138-daf8a05202ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb350cf-6a02-4ede-be92-0a7863bc0475", "name": "network-vif-plugged", "status": "completed", "tag": "b71d89e6-8615-4c4e-8651-e32f4872be93"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:18.340414 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-3b7e69f3-7dc6-456a-aaed-fcb4019975c0 req-f24ae32e-d74c-4e40-9138-daf8a05202ef service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:18.340838 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-3b7e69f3-7dc6-456a-aaed-fcb4019975c0 req-f24ae32e-d74c-4e40-9138-daf8a05202ef service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:18.355025 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-3b7e69f3-7dc6-456a-aaed-fcb4019975c0 req-f24ae32e-d74c-4e40-9138-daf8a05202ef service nova] Creating event network-vif-plugged:b71d89e6-8615-4c4e-8651-e32f4872be93 for instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 on hv-cinder-79760 Jul 04 08:10:18.360904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-3b7e69f3-7dc6-456a-aaed-fcb4019975c0 req-f24ae32e-d74c-4e40-9138-daf8a05202ef service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035794 Jul 04 08:10:18.361298 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 471/881] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:18.501167 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4caf9493-7712-49b5-8702-44a68bc36b55 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:18.502271 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4caf9493-7712-49b5-8702-44a68bc36b55 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:18.505192 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:18.512091 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4caf9493-7712-49b5-8702-44a68bc36b55 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:18.512556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4caf9493-7712-49b5-8702-44a68bc36b55 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:18.513366 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4caf9493-7712-49b5-8702-44a68bc36b55 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:18.513830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4caf9493-7712-49b5-8702-44a68bc36b55 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:18.553286 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e07b2429-973e-4637-866e-7d81c7557309 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:18.554091 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e07b2429-973e-4637-866e-7d81c7557309 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:18.561010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e07b2429-973e-4637-866e-7d81c7557309 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:18.561540 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e07b2429-973e-4637-866e-7d81c7557309 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:18.562404 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e07b2429-973e-4637-866e-7d81c7557309 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:18.562892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e07b2429-973e-4637-866e-7d81c7557309 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:18.635629 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e07b2429-973e-4637-866e-7d81c7557309 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:18.643652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e07b2429-973e-4637-866e-7d81c7557309 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1512 microversion: 2.1 time: 0.096169 Jul 04 08:10:18.644511 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 472/882] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:18 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1512 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:18.660393 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4caf9493-7712-49b5-8702-44a68bc36b55 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:18.662648 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:18.669404 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4caf9493-7712-49b5-8702-44a68bc36b55 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1688 microversion: 2.1 time: 0.172224 Jul 04 08:10:18.670014 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 411/883] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:18 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:18.688956 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:18.689780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:18.696428 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:18.696912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:18.697685 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:18.698151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:18.837589 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:18.847954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:18.849268 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:18.850460 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7579a8bc-4bea-4315-befb-144937730ecd tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.166587 Jul 04 08:10:18.851122 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 473/884] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:18 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:18.857230 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c880f2e9-f01e-4fd8-9de9-8d834c375457 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:18.857892 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c880f2e9-f01e-4fd8-9de9-8d834c375457 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:18.865009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c880f2e9-f01e-4fd8-9de9-8d834c375457 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:18.865458 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c880f2e9-f01e-4fd8-9de9-8d834c375457 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:18.866263 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c880f2e9-f01e-4fd8-9de9-8d834c375457 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:18.866694 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c880f2e9-f01e-4fd8-9de9-8d834c375457 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:19.014142 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c880f2e9-f01e-4fd8-9de9-8d834c375457 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:19.022916 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c880f2e9-f01e-4fd8-9de9-8d834c375457 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1519 microversion: 2.1 time: 0.170381 Jul 04 08:10:19.023531 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 412/885] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:18 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:19.661957 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6c525c37-5be5-423a-bf5a-6409daa6fef2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:19.662562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6c525c37-5be5-423a-bf5a-6409daa6fef2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:19.669423 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c525c37-5be5-423a-bf5a-6409daa6fef2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:19.669904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c525c37-5be5-423a-bf5a-6409daa6fef2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:19.670677 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c525c37-5be5-423a-bf5a-6409daa6fef2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:19.671174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c525c37-5be5-423a-bf5a-6409daa6fef2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:19.686851 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-88707df0-e916-4e8d-b190-b9bb2d7fa072 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:19.687628 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-88707df0-e916-4e8d-b190-b9bb2d7fa072 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:19.696453 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88707df0-e916-4e8d-b190-b9bb2d7fa072 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:19.697408 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88707df0-e916-4e8d-b190-b9bb2d7fa072 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:19.698467 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88707df0-e916-4e8d-b190-b9bb2d7fa072 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:19.699158 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88707df0-e916-4e8d-b190-b9bb2d7fa072 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:19.739359 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6c525c37-5be5-423a-bf5a-6409daa6fef2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:19.747455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6c525c37-5be5-423a-bf5a-6409daa6fef2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1226 microversion: 2.1 time: 0.090576 Jul 04 08:10:19.748063 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 474/886] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:19 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:19.869879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:19.870542 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:19.876723 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:19.877394 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:19.878538 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:19.879000 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:19.996615 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-88707df0-e916-4e8d-b190-b9bb2d7fa072 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:20.006302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-88707df0-e916-4e8d-b190-b9bb2d7fa072 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1688 microversion: 2.1 time: 0.323645 Jul 04 08:10:20.006905 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 413/887] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:19 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1688 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:20.040778 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9019f381-eace-4075-a2de-27e8ccfdbb4f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:20.041392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9019f381-eace-4075-a2de-27e8ccfdbb4f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:20.052211 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9019f381-eace-4075-a2de-27e8ccfdbb4f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:20.052893 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9019f381-eace-4075-a2de-27e8ccfdbb4f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:20.054214 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9019f381-eace-4075-a2de-27e8ccfdbb4f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:20.055428 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9019f381-eace-4075-a2de-27e8ccfdbb4f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:20.080324 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:20.102321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:20.126367 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:20.128733 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-db43908a-580c-4738-bfc5-a04e887b5850 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.262779 Jul 04 08:10:20.130491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 475/888] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:19 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:20.486663 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9019f381-eace-4075-a2de-27e8ccfdbb4f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:20.495532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9019f381-eace-4075-a2de-27e8ccfdbb4f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1519 microversion: 2.1 time: 0.458856 Jul 04 08:10:20.496107 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 414/889] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:20 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1519 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:20.765063 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:20.765689 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:20.772895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:20.773333 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:20.774137 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:20.774563 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:20.808231 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:20.808868 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:20.809465 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lazy-loading 'fault' on Instance uuid 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:20.852859 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:20.861012 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-15725ee7-8991-404b-b4c4-d74101a8b562 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1231 microversion: 2.1 time: 0.099940 Jul 04 08:10:20.861596 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 476/890] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:20 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:20.922940 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-e73f50c0-59a8-41f5-855e-7d3a2b9af459 req-c8f78fb6-8c2f-4fdf-9e8b-96dbfe57df8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ab500b1-c48b-483c-978c-c34e45412a3a", "name": "network-vif-deleted", "tag": "7cbefb7a-840f-4963-a04b-770627ab4955"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:20.931915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-e73f50c0-59a8-41f5-855e-7d3a2b9af459 req-c8f78fb6-8c2f-4fdf-9e8b-96dbfe57df8d service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:20.932394 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-e73f50c0-59a8-41f5-855e-7d3a2b9af459 req-c8f78fb6-8c2f-4fdf-9e8b-96dbfe57df8d service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:20.944021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-e73f50c0-59a8-41f5-855e-7d3a2b9af459 req-c8f78fb6-8c2f-4fdf-9e8b-96dbfe57df8d service nova] Creating event network-vif-deleted:7cbefb7a-840f-4963-a04b-770627ab4955 for instance 3ab500b1-c48b-483c-978c-c34e45412a3a on hv-cinder-79760 Jul 04 08:10:20.949277 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-e73f50c0-59a8-41f5-855e-7d3a2b9af459 req-c8f78fb6-8c2f-4fdf-9e8b-96dbfe57df8d service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029838 Jul 04 08:10:20.949902 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 415/891] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:21.026881 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5381de98-fa38-46e2-bb68-17df78637401 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:21.027491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5381de98-fa38-46e2-bb68-17df78637401 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:21.033566 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5381de98-fa38-46e2-bb68-17df78637401 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.034225 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5381de98-fa38-46e2-bb68-17df78637401 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.035254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5381de98-fa38-46e2-bb68-17df78637401 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.035803 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5381de98-fa38-46e2-bb68-17df78637401 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.100271 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5381de98-fa38-46e2-bb68-17df78637401 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:21.109309 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5381de98-fa38-46e2-bb68-17df78637401 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1621 microversion: 2.1 time: 0.088278 Jul 04 08:10:21.110473 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 477/892] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:21 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1621 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:21.152441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:21.153147 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:21.161092 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.161542 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.162377 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.162803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.314001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:21.325185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:21.327024 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:21.328593 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f8bff9f0-3e56-4371-a2ab-66f82a615c8d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.180879 Jul 04 08:10:21.331107 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 416/893] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:21 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:21.456842 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0651aa6a-d5d5-4127-a957-a7b5c67ef3e4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:21.457526 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0651aa6a-d5d5-4127-a957-a7b5c67ef3e4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:21.464166 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0651aa6a-d5d5-4127-a957-a7b5c67ef3e4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.464602 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0651aa6a-d5d5-4127-a957-a7b5c67ef3e4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.465363 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0651aa6a-d5d5-4127-a957-a7b5c67ef3e4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.465825 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0651aa6a-d5d5-4127-a957-a7b5c67ef3e4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.496719 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0651aa6a-d5d5-4127-a957-a7b5c67ef3e4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/ips" status: 200 len: 151 microversion: 2.1 time: 0.043775 Jul 04 08:10:21.497308 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 478/894] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:10:21 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:21.517480 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1cb57a2c-47ac-46b2-b7f3-7dcc85f4a52c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:21.518542 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1cb57a2c-47ac-46b2-b7f3-7dcc85f4a52c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:21.528623 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1cb57a2c-47ac-46b2-b7f3-7dcc85f4a52c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.529346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1cb57a2c-47ac-46b2-b7f3-7dcc85f4a52c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.530676 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1cb57a2c-47ac-46b2-b7f3-7dcc85f4a52c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.531384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1cb57a2c-47ac-46b2-b7f3-7dcc85f4a52c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.683554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1cb57a2c-47ac-46b2-b7f3-7dcc85f4a52c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:21.692246 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1cb57a2c-47ac-46b2-b7f3-7dcc85f4a52c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1519 microversion: 2.1 time: 0.181593 Jul 04 08:10:21.693747 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 417/895] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:21 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:21.891660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:21.893037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:21.901710 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.902435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.903410 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.904149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.950455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:21.950978 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:21.951545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lazy-loading 'fault' on Instance uuid 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:21.955804 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:21.999995 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:22.009957 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5a3b56f4-8d90-4251-bfe7-0f9f7383c6a1 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 200 len: 1185 microversion: 2.1 time: 0.135726 Jul 04 08:10:22.010548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 479/896] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:21 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 1185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:22.128497 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:22.129314 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:22.137351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:22.137897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:22.138894 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:22.139412 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:22.185312 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:22.185855 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:22.186375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'fault' on Instance uuid 3ab500b1-c48b-483c-978c-c34e45412a3a {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:22.236417 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:22.246224 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-26489f04-74a3-42bc-b0c2-4e73e9ca051c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 200 len: 1336 microversion: 2.1 time: 0.122597 Jul 04 08:10:22.246799 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 418/897] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:22 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:22.349336 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:22.349863 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:22.356432 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:22.356867 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:22.357652 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:22.358073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:22.501721 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:22.510886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:22.512814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:22.514079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-54309013-3f8d-411f-adee-d8b51ec95d98 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1733 microversion: 2.20 time: 0.169122 Jul 04 08:10:22.514678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 480/898] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:22 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:22.709867 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0bc94964-e6fb-4cc8-8525-b5e5fd6080ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:22.710436 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0bc94964-e6fb-4cc8-8525-b5e5fd6080ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:22.717322 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0bc94964-e6fb-4cc8-8525-b5e5fd6080ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:22.717798 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0bc94964-e6fb-4cc8-8525-b5e5fd6080ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:22.718584 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0bc94964-e6fb-4cc8-8525-b5e5fd6080ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:22.719016 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0bc94964-e6fb-4cc8-8525-b5e5fd6080ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:22.868759 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8f7f35dd-425a-4231-a2b5-7fe85093e921 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35c279e6-19b7-4ad0-914c-1b6e1bf224ad"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:22.870010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8f7f35dd-425a-4231-a2b5-7fe85093e921 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:22.877231 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8f7f35dd-425a-4231-a2b5-7fe85093e921 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:22.877231 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8f7f35dd-425a-4231-a2b5-7fe85093e921 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:22.878475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8f7f35dd-425a-4231-a2b5-7fe85093e921 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:22.878929 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8f7f35dd-425a-4231-a2b5-7fe85093e921 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:22.893919 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0bc94964-e6fb-4cc8-8525-b5e5fd6080ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:22.902919 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0bc94964-e6fb-4cc8-8525-b5e5fd6080ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1519 microversion: 2.1 time: 0.197137 Jul 04 08:10:22.903504 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 419/899] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:22 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:23.027462 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:23.028062 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:23.034342 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:23.034777 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:23.035765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:23.036199 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:23.050903 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] HTTP exception thrown: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Request method failure captured: Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 HTTP/1.1 Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp-JFn-CxKVQny0eU9lT-0Jn7160KdyxiV8v6lv2916EujzcoOEFGbIgjM9-DRpubHQGJQgsaYQzrvffvdBrPBraI27sMur0-T6YKZPZ00jgj3Sc5tgOHyWpimZJKmU4C7UpMnnfH3MZM23bZsA69JXs8D0IsHA30Ru7dZTu-GeSsEw Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:10:23.052607 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1b0f9c7bc044f6c802c8cd34da4eb0e", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: fa28f0e0b3b0488faf7db7bf7dc3854b Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:10:23.054488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '2cf097eb-a2e5-4ce3-b0d9-1104988fe661'} Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:23.056302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:10:23.057874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.059219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Returning 404 to user: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:23.059219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-46b48143-2e60-478d-81f1-d97f4ea017c6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 404 len: 111 microversion: 2.1 time: 0.030876 Jul 04 08:10:23.059219 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 420/900] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:23 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 08:10:23.167888 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-752576005", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1698566224", "security_groups": [{"name": "tempest-secgroup-smoke-1279218911"}], "block_device_mapping_v2": [{"uuid": "11b6e2f3-74aa-47e8-81a4-b650af633521", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ae013d11-69a5-488a-bc48-9896b5be9f9a"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:23.307173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] validate_networks() for [('ae013d11-69a5-488a-bc48-9896b5be9f9a', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:10:23.568783 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8f7f35dd-425a-4231-a2b5-7fe85093e921 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "POST /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.704091 Jul 04 08:10:23.569768 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 481/901] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:10:22 2022] POST /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments => generated 194 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:10:23.575565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:23.576829 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 3ab500b1-c48b-483c-978c-c34e45412a3a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:23.584606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:23.585419 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:23.586500 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:23.587115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:23.604023 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] HTTP exception thrown: Instance 3ab500b1-c48b-483c-978c-c34e45412a3a could not be found. Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Request method failure captured: Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a HTTP/1.1 Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp86y5zB6tJmUvnCBxloMYPfz3Qu1J2vZNvALy11_SGklA0-6zpcp9i-qXZg_aKmNOY0KAVoTThFHL2J5xGD8lKRaA6HbDycVJoWay3Tx1aFQSmAK8oaRsWv5iQSyEwBVsMcnSHDiqUgbMRRPkeTzsn1MKqYqaic2Kn1UZ2Z_VEiH1s Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:23.606052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ecd5bc804a3b4f14b864fb4e0f8d1b98", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 9e3f73e469f34b66bfbe99c3d79ac129 Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 3ab500b1-c48b-483c-978c-c34e45412a3a could not be found. Jul 04 08:10:23.607599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '3ab500b1-c48b-483c-978c-c34e45412a3a'} Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ab500b1-c48b-483c-978c-c34e45412a3a could not be found. Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:23.608667 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ab500b1-c48b-483c-978c-c34e45412a3a could not be found. Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ab500b1-c48b-483c-978c-c34e45412a3a could not be found. Jul 04 08:10:23.610027 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:23.611886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Returning 404 to user: Instance 3ab500b1-c48b-483c-978c-c34e45412a3a could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:23.612901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5a5d8303-ef6f-4294-8bd7-0a9fafde593a tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a" status: 404 len: 111 microversion: 2.1 time: 0.041803 Jul 04 08:10:23.613883 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 482/902] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:23 2022] GET /compute/v2.1/servers/3ab500b1-c48b-483c-978c-c34e45412a3a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:23.619346 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:23.619789 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:23.626415 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:23.626858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:23.627954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:23.628382 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:23.778620 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:23.788623 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:23.790166 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:23.791397 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cb9f9a2c-0b2a-43d2-973d-d7926f81ee50 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1720 microversion: 2.20 time: 0.176562 Jul 04 08:10:23.791984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 483/903] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:23 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1720 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:10:23.796843 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-abb6ee5e-35de-4cc6-9dc6-fc21a691b346 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '.version_select at 0x7f05e55d3700>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:23.827286 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-abb6ee5e-35de-4cc6-9dc6-fc21a691b346 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632504715" status: 202 len: 0 microversion: 2.1 time: 0.034016 Jul 04 08:10:23.827830 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 484/904] 10.222.0.43 () {58 vars in 1220 bytes} [Mon Jul 4 08:10:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632504715 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:10:23.925153 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cdeef124-9250-4f96-9576-c479b4d1e0a7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:23.926117 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cdeef124-9250-4f96-9576-c479b4d1e0a7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:23.936111 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdeef124-9250-4f96-9576-c479b4d1e0a7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:23.936884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdeef124-9250-4f96-9576-c479b4d1e0a7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:23.938672 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdeef124-9250-4f96-9576-c479b4d1e0a7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:23.939458 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdeef124-9250-4f96-9576-c479b4d1e0a7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:24.099745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:10:24.100092 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:10:24.100749 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:10:24.101311 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:10:24.101907 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:10:24.125092 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:24.125544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:24.126497 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:24.127017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:24.150005 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Getting quotas for project d1b0f9c7bc044f6c802c8cd34da4eb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:10:24.157205 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Getting quotas for user fa28f0e0b3b0488faf7db7bf7dc3854b and project d1b0f9c7bc044f6c802c8cd34da4eb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:10:24.203459 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cdeef124-9250-4f96-9576-c479b4d1e0a7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:24.221482 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cdeef124-9250-4f96-9576-c479b4d1e0a7 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1519 microversion: 2.1 time: 0.301808 Jul 04 08:10:24.224366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 485/905] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:23 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1519 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:24.324307 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:10:24.326400 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11b6e2f3-74aa-47e8-81a4-b650af633521',volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:10:24.369538 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-32dc0bfe-4163-4952-887b-5c5cec7905e1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:24.370616 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-32dc0bfe-4163-4952-887b-5c5cec7905e1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:24.381374 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32dc0bfe-4163-4952-887b-5c5cec7905e1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:24.382075 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32dc0bfe-4163-4952-887b-5c5cec7905e1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:24.383068 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32dc0bfe-4163-4952-887b-5c5cec7905e1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:24.383564 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32dc0bfe-4163-4952-887b-5c5cec7905e1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:24.424503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-32dc0bfe-4163-4952-887b-5c5cec7905e1 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058868 Jul 04 08:10:24.433180 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 486/906] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:24 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments => generated 371 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:24.498714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-62b08824-aa20-4f1c-b3c4-9b814101d1cb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.336933 Jul 04 08:10:24.500185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 421/907] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:10:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1340 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:10:24.510516 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3319bf6a-1856-463a-93c2-812bde0238e2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:24.511530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3319bf6a-1856-463a-93c2-812bde0238e2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:24.570449 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3319bf6a-1856-463a-93c2-812bde0238e2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:24.571821 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f8043a83-6cff-4da9-8998-8b975b36e009 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:24.572428 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f8043a83-6cff-4da9-8998-8b975b36e009 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:24.578485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3319bf6a-1856-463a-93c2-812bde0238e2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1094 microversion: 2.1 time: 0.071944 Jul 04 08:10:24.581668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 487/908] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:24 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:24.583680 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8043a83-6cff-4da9-8998-8b975b36e009 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:24.584432 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8043a83-6cff-4da9-8998-8b975b36e009 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:24.585355 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8043a83-6cff-4da9-8998-8b975b36e009 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:24.585974 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8043a83-6cff-4da9-8998-8b975b36e009 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:24.618983 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f8043a83-6cff-4da9-8998-8b975b36e009 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/5c39389d-616c-409c-bc28-772c6f62c899" status: 200 len: 194 microversion: 2.1 time: 0.053945 Jul 04 08:10:24.620174 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 422/909] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Jul 4 08:10:24 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/5c39389d-616c-409c-bc28-772c6f62c899 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:10:24.637428 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2fc84d9f-7387-4baa-8e4e-23d4d1e27969 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:24.637951 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2fc84d9f-7387-4baa-8e4e-23d4d1e27969 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:24.647821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fc84d9f-7387-4baa-8e4e-23d4d1e27969 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:24.648275 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fc84d9f-7387-4baa-8e4e-23d4d1e27969 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:24.649208 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fc84d9f-7387-4baa-8e4e-23d4d1e27969 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:24.649662 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fc84d9f-7387-4baa-8e4e-23d4d1e27969 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:24.954716 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-2fc84d9f-7387-4baa-8e4e-23d4d1e27969 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lazy-loading 'services' on Instance uuid 1fbad2f2-0053-4c22-a052-48d2265b2c6c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:25.093145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2fc84d9f-7387-4baa-8e4e-23d4d1e27969 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/5c39389d-616c-409c-bc28-772c6f62c899" status: 202 len: 0 microversion: 2.1 time: 0.466758 Jul 04 08:10:25.093804 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 488/910] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:10:24 2022] DELETE /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/5c39389d-616c-409c-bc28-772c6f62c899 => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:10:25.241241 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-11f379ac-d058-4c9b-871d-73e55f048332 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:25.241951 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-11f379ac-d058-4c9b-871d-73e55f048332 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:25.250251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-11f379ac-d058-4c9b-871d-73e55f048332 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:25.250705 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-11f379ac-d058-4c9b-871d-73e55f048332 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:25.251540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-11f379ac-d058-4c9b-871d-73e55f048332 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:25.252141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-11f379ac-d058-4c9b-871d-73e55f048332 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:25.430766 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-11f379ac-d058-4c9b-871d-73e55f048332 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:25.439360 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-11f379ac-d058-4c9b-871d-73e55f048332 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.202533 Jul 04 08:10:25.439859 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 423/911] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:25 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:25.597984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d40c09ef-cfbc-4284-a234-cada68aedd0a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:25.598746 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d40c09ef-cfbc-4284-a234-cada68aedd0a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:25.606408 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d40c09ef-cfbc-4284-a234-cada68aedd0a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:25.606846 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d40c09ef-cfbc-4284-a234-cada68aedd0a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:25.607600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d40c09ef-cfbc-4284-a234-cada68aedd0a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:25.608174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d40c09ef-cfbc-4284-a234-cada68aedd0a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:25.679283 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d40c09ef-cfbc-4284-a234-cada68aedd0a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:25.690413 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d40c09ef-cfbc-4284-a234-cada68aedd0a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1192 microversion: 2.1 time: 0.097543 Jul 04 08:10:25.691815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 489/912] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:25 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:26.456597 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a1afec99-ba94-4277-8202-b29338499def tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:26.457325 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a1afec99-ba94-4277-8202-b29338499def tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:26.466043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1afec99-ba94-4277-8202-b29338499def tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:26.466043 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1afec99-ba94-4277-8202-b29338499def tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:26.466738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1afec99-ba94-4277-8202-b29338499def tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:26.467159 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a1afec99-ba94-4277-8202-b29338499def tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:26.705240 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a1afec99-ba94-4277-8202-b29338499def tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:26.709502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-af58fd59-aca5-4c24-9362-3cf1ed3e4a54 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:26.710256 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-af58fd59-aca5-4c24-9362-3cf1ed3e4a54 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:26.713468 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a1afec99-ba94-4277-8202-b29338499def tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.260839 Jul 04 08:10:26.714082 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 424/913] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:26 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:26.727355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af58fd59-aca5-4c24-9362-3cf1ed3e4a54 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:26.727790 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af58fd59-aca5-4c24-9362-3cf1ed3e4a54 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:26.728565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af58fd59-aca5-4c24-9362-3cf1ed3e4a54 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:26.728992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-af58fd59-aca5-4c24-9362-3cf1ed3e4a54 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:26.896752 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-af58fd59-aca5-4c24-9362-3cf1ed3e4a54 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:26.905796 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-af58fd59-aca5-4c24-9362-3cf1ed3e4a54 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1278 microversion: 2.1 time: 0.201221 Jul 04 08:10:26.908264 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 490/914] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:26 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1278 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:27.237910 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0c0bce43-9ccd-4cf1-b25d-48df7f773fc4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:27.238609 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0c0bce43-9ccd-4cf1-b25d-48df7f773fc4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:27.245419 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c0bce43-9ccd-4cf1-b25d-48df7f773fc4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:27.245976 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c0bce43-9ccd-4cf1-b25d-48df7f773fc4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:27.246960 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c0bce43-9ccd-4cf1-b25d-48df7f773fc4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:27.247457 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0c0bce43-9ccd-4cf1-b25d-48df7f773fc4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:27.277754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0c0bce43-9ccd-4cf1-b25d-48df7f773fc4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:10:27.402930 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0c0bce43-9ccd-4cf1-b25d-48df7f773fc4 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 204 len: 0 microversion: 2.1 time: 0.168654 Jul 04 08:10:27.403849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 425/915] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:27 2022] DELETE /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:10:27.412326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7ca5fdbf-aec3-49af-b208-7880382f72f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:27.412947 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7ca5fdbf-aec3-49af-b208-7880382f72f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:27.420469 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7ca5fdbf-aec3-49af-b208-7880382f72f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:27.420931 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7ca5fdbf-aec3-49af-b208-7880382f72f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:27.421760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7ca5fdbf-aec3-49af-b208-7880382f72f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:27.422196 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7ca5fdbf-aec3-49af-b208-7880382f72f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:27.577214 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7ca5fdbf-aec3-49af-b208-7880382f72f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:27.603510 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7ca5fdbf-aec3-49af-b208-7880382f72f3 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1508 microversion: 2.1 time: 0.194932 Jul 04 08:10:27.609486 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-864fb22b-40d5-4afe-a09b-1974f618d9af req-ea108a4b-89df-4fb4-8306-b9e8ad63d0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4231e66-b993-47b6-9da6-869b1258d7ed", "tag": "65fb0420-dfb3-4fe8-b366-98253c495984"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:27.618814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 491/916] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:27 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1508 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:27.620725 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-864fb22b-40d5-4afe-a09b-1974f618d9af req-ea108a4b-89df-4fb4-8306-b9e8ad63d0cd service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:27.621102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-864fb22b-40d5-4afe-a09b-1974f618d9af req-ea108a4b-89df-4fb4-8306-b9e8ad63d0cd service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:27.636904 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-864fb22b-40d5-4afe-a09b-1974f618d9af req-ea108a4b-89df-4fb4-8306-b9e8ad63d0cd service nova] Creating event network-changed:65fb0420-dfb3-4fe8-b366-98253c495984 for instance c4231e66-b993-47b6-9da6-869b1258d7ed on hv-cinder-79760 Jul 04 08:10:27.643610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-864fb22b-40d5-4afe-a09b-1974f618d9af req-ea108a4b-89df-4fb4-8306-b9e8ad63d0cd service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042058 Jul 04 08:10:27.644705 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 426/917] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:10:27.732913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dbe22a45-0f24-4445-a1af-b9a49dc580ad tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:27.733775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-dbe22a45-0f24-4445-a1af-b9a49dc580ad tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:27.742637 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dbe22a45-0f24-4445-a1af-b9a49dc580ad tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:27.743084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dbe22a45-0f24-4445-a1af-b9a49dc580ad tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:27.743882 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dbe22a45-0f24-4445-a1af-b9a49dc580ad tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:27.744389 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dbe22a45-0f24-4445-a1af-b9a49dc580ad tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:27.893914 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dbe22a45-0f24-4445-a1af-b9a49dc580ad tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:27.903238 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-dbe22a45-0f24-4445-a1af-b9a49dc580ad tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.174955 Jul 04 08:10:27.904653 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 492/918] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:27 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:27.925571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-08ae5db9-41c6-4def-84d6-125276ffb97c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:27.926830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-08ae5db9-41c6-4def-84d6-125276ffb97c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:27.934649 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08ae5db9-41c6-4def-84d6-125276ffb97c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:27.935387 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08ae5db9-41c6-4def-84d6-125276ffb97c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:27.936237 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08ae5db9-41c6-4def-84d6-125276ffb97c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:27.936731 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08ae5db9-41c6-4def-84d6-125276ffb97c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:28.096922 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08ae5db9-41c6-4def-84d6-125276ffb97c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:28.106760 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-08ae5db9-41c6-4def-84d6-125276ffb97c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1278 microversion: 2.1 time: 0.186964 Jul 04 08:10:28.107645 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 427/919] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:27 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1278 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:28.626281 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f50d3b8d-9332-4d4a-b76e-a85bd5087dad tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:28.626769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f50d3b8d-9332-4d4a-b76e-a85bd5087dad tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:28.633961 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f50d3b8d-9332-4d4a-b76e-a85bd5087dad tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:28.634658 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f50d3b8d-9332-4d4a-b76e-a85bd5087dad tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:28.635473 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f50d3b8d-9332-4d4a-b76e-a85bd5087dad tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:28.635903 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f50d3b8d-9332-4d4a-b76e-a85bd5087dad tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:28.801593 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f50d3b8d-9332-4d4a-b76e-a85bd5087dad tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:28.813806 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f50d3b8d-9332-4d4a-b76e-a85bd5087dad tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1508 microversion: 2.1 time: 0.191116 Jul 04 08:10:28.815613 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 493/920] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:28 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:28.921351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-37c133a9-05cb-48c9-a172-f5a71fd1b0c6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:28.924350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-37c133a9-05cb-48c9-a172-f5a71fd1b0c6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:28.932775 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37c133a9-05cb-48c9-a172-f5a71fd1b0c6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:28.933519 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37c133a9-05cb-48c9-a172-f5a71fd1b0c6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:28.934547 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37c133a9-05cb-48c9-a172-f5a71fd1b0c6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:28.935182 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-37c133a9-05cb-48c9-a172-f5a71fd1b0c6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:29.087777 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-37c133a9-05cb-48c9-a172-f5a71fd1b0c6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:29.095984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-37c133a9-05cb-48c9-a172-f5a71fd1b0c6 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.179080 Jul 04 08:10:29.096573 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 428/921] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:28 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:29.130156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3c852435-3812-45d1-81e8-5c05aaefa94a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:29.130780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3c852435-3812-45d1-81e8-5c05aaefa94a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:29.137477 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c852435-3812-45d1-81e8-5c05aaefa94a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:29.137940 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c852435-3812-45d1-81e8-5c05aaefa94a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:29.138744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c852435-3812-45d1-81e8-5c05aaefa94a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:29.139165 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c852435-3812-45d1-81e8-5c05aaefa94a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:29.289564 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3c852435-3812-45d1-81e8-5c05aaefa94a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:29.297862 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3c852435-3812-45d1-81e8-5c05aaefa94a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1278 microversion: 2.1 time: 0.172691 Jul 04 08:10:29.298452 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 494/922] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:29 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:29.838680 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e7530e5c-dcdc-496c-a79a-fc6b8f6674f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:29.839902 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e7530e5c-dcdc-496c-a79a-fc6b8f6674f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:29.846403 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7530e5c-dcdc-496c-a79a-fc6b8f6674f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:29.846849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7530e5c-dcdc-496c-a79a-fc6b8f6674f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:29.847731 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7530e5c-dcdc-496c-a79a-fc6b8f6674f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:29.848129 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e7530e5c-dcdc-496c-a79a-fc6b8f6674f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:29.851517 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:30.088028 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-e7530e5c-dcdc-496c-a79a-fc6b8f6674f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:30.096260 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e7530e5c-dcdc-496c-a79a-fc6b8f6674f5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1508 microversion: 2.1 time: 0.261431 Jul 04 08:10:30.097396 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 429/923] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:29 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1508 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:30.114762 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-873b778b-f580-4703-a608-771c080ec4ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:30.115414 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-873b778b-f580-4703-a608-771c080ec4ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:30.122453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-873b778b-f580-4703-a608-771c080ec4ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:30.122979 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-873b778b-f580-4703-a608-771c080ec4ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:30.123844 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-873b778b-f580-4703-a608-771c080ec4ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:30.124397 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-873b778b-f580-4703-a608-771c080ec4ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:30.295141 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-873b778b-f580-4703-a608-771c080ec4ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:30.303665 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-873b778b-f580-4703-a608-771c080ec4ee tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.193263 Jul 04 08:10:30.304350 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 495/924] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:30 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:30.315016 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4dcb3e9b-5211-4409-b841-c8b7883a30b0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:30.315630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4dcb3e9b-5211-4409-b841-c8b7883a30b0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:30.322486 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4dcb3e9b-5211-4409-b841-c8b7883a30b0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:30.322900 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4dcb3e9b-5211-4409-b841-c8b7883a30b0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:30.323895 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4dcb3e9b-5211-4409-b841-c8b7883a30b0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:30.324326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4dcb3e9b-5211-4409-b841-c8b7883a30b0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:30.386927 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-7d5bdbf0-ee59-49f9-ac92-ff9a0657d810 req-f4cc9736-2038-43cd-a938-0690b2b761d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d165c5-1758-4475-b335-7eb6f12f7d3c", "name": "network-vif-deleted", "tag": "e31114ef-5009-42b7-86f6-1482f88fd705"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:30.396861 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-7d5bdbf0-ee59-49f9-ac92-ff9a0657d810 req-f4cc9736-2038-43cd-a938-0690b2b761d3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:30.397312 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-7d5bdbf0-ee59-49f9-ac92-ff9a0657d810 req-f4cc9736-2038-43cd-a938-0690b2b761d3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:30.410983 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-7d5bdbf0-ee59-49f9-ac92-ff9a0657d810 req-f4cc9736-2038-43cd-a938-0690b2b761d3 service nova] Creating event network-vif-deleted:e31114ef-5009-42b7-86f6-1482f88fd705 for instance c5d165c5-1758-4475-b335-7eb6f12f7d3c on hv-cinder-79760 Jul 04 08:10:30.417615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-7d5bdbf0-ee59-49f9-ac92-ff9a0657d810 req-f4cc9736-2038-43cd-a938-0690b2b761d3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036704 Jul 04 08:10:30.434062 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 496/925] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:10:30.552016 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4dcb3e9b-5211-4409-b841-c8b7883a30b0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:30.569450 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4dcb3e9b-5211-4409-b841-c8b7883a30b0 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1278 microversion: 2.1 time: 0.257730 Jul 04 08:10:30.570762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 430/926] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:30 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1278 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:31.118691 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:31.120678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:31.133897 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:31.136479 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.137270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.138250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.138653 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.164211 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:31.185964 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.186484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.187007 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'fault' on Instance uuid c5d165c5-1758-4475-b335-7eb6f12f7d3c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:31.244061 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:31.256986 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7baaadd4-383a-4549-82e0-8e89b0aa0d10 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1312 microversion: 2.1 time: 0.146036 Jul 04 08:10:31.257590 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 497/927] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:31 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:31.325197 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f174e576-e263-4af2-99fc-faa8ebb1b824 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:31.327020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f174e576-e263-4af2-99fc-faa8ebb1b824 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:31.336507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f174e576-e263-4af2-99fc-faa8ebb1b824 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.337010 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f174e576-e263-4af2-99fc-faa8ebb1b824 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.338001 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f174e576-e263-4af2-99fc-faa8ebb1b824 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.338389 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f174e576-e263-4af2-99fc-faa8ebb1b824 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.373314 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3a6937f5-33b3-45e3-af8c-bd43d29be67f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:31.374160 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3a6937f5-33b3-45e3-af8c-bd43d29be67f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:31.382218 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a6937f5-33b3-45e3-af8c-bd43d29be67f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.382675 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a6937f5-33b3-45e3-af8c-bd43d29be67f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.383468 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a6937f5-33b3-45e3-af8c-bd43d29be67f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.383898 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a6937f5-33b3-45e3-af8c-bd43d29be67f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.481827 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-3a6937f5-33b3-45e3-af8c-bd43d29be67f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lazy-loading 'services' on Instance uuid a4b07442-ab28-4f72-8fbd-36f683a8f50c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:31.515186 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f174e576-e263-4af2-99fc-faa8ebb1b824 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:31.524395 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f174e576-e263-4af2-99fc-faa8ebb1b824 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.206717 Jul 04 08:10:31.525517 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 431/928] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:31 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:31.579545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3a6937f5-33b3-45e3-af8c-bd43d29be67f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments/35c279e6-19b7-4ad0-914c-1b6e1bf224ad" status: 202 len: 0 microversion: 2.1 time: 0.212743 Jul 04 08:10:31.584533 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 498/929] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:10:31 2022] DELETE /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments/35c279e6-19b7-4ad0-914c-1b6e1bf224ad => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:10:31.590403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f2e58253-fd82-45c0-953b-7aa4beb7de40 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:31.591403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f2e58253-fd82-45c0-953b-7aa4beb7de40 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:31.594637 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-165207d1-d6b6-4393-aee5-ae9fdf8c4cf2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:31.595971 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-165207d1-d6b6-4393-aee5-ae9fdf8c4cf2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:31.598965 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2e58253-fd82-45c0-953b-7aa4beb7de40 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.599447 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2e58253-fd82-45c0-953b-7aa4beb7de40 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.600245 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2e58253-fd82-45c0-953b-7aa4beb7de40 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.600688 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2e58253-fd82-45c0-953b-7aa4beb7de40 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.607726 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-165207d1-d6b6-4393-aee5-ae9fdf8c4cf2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.608523 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-165207d1-d6b6-4393-aee5-ae9fdf8c4cf2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.609946 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-165207d1-d6b6-4393-aee5-ae9fdf8c4cf2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:31.610715 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-165207d1-d6b6-4393-aee5-ae9fdf8c4cf2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:31.632899 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f2e58253-fd82-45c0-953b-7aa4beb7de40 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046941 Jul 04 08:10:31.633542 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 499/930] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:31 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:31.757404 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-165207d1-d6b6-4393-aee5-ae9fdf8c4cf2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:31.766414 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-165207d1-d6b6-4393-aee5-ae9fdf8c4cf2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1278 microversion: 2.1 time: 0.179027 Jul 04 08:10:31.767037 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 432/931] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:31 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1278 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:32.275384 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:32.276137 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:32.283230 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:32.283715 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:32.284435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:32.284949 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:32.325734 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:32.326174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:32.326631 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'fault' on Instance uuid c5d165c5-1758-4475-b335-7eb6f12f7d3c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:32.375073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:32.385600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6b9b8e90-8615-4d46-a45e-6bc3e74fd65b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 200 len: 1312 microversion: 2.1 time: 0.113822 Jul 04 08:10:32.386534 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 500/932] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:32 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:32.546199 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-01eaf2b8-2566-452b-aefd-f2425d7ef135 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:32.546799 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-01eaf2b8-2566-452b-aefd-f2425d7ef135 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:32.554778 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-01eaf2b8-2566-452b-aefd-f2425d7ef135 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:32.555234 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-01eaf2b8-2566-452b-aefd-f2425d7ef135 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:32.556027 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-01eaf2b8-2566-452b-aefd-f2425d7ef135 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:32.556460 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-01eaf2b8-2566-452b-aefd-f2425d7ef135 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:32.649147 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-61e90be7-6eb6-4ad4-95a1-dc408e34fb53 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:32.652115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-61e90be7-6eb6-4ad4-95a1-dc408e34fb53 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:32.673741 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61e90be7-6eb6-4ad4-95a1-dc408e34fb53 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:32.674897 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61e90be7-6eb6-4ad4-95a1-dc408e34fb53 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:32.676703 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61e90be7-6eb6-4ad4-95a1-dc408e34fb53 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:32.677854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61e90be7-6eb6-4ad4-95a1-dc408e34fb53 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:32.748936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-61e90be7-6eb6-4ad4-95a1-dc408e34fb53 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107158 Jul 04 08:10:32.750476 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 501/933] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:32 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:10:32.785765 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e604e9d2-6d81-4a2e-8e12-f85bf58c8c0b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:32.786696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e604e9d2-6d81-4a2e-8e12-f85bf58c8c0b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:32.795435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-01eaf2b8-2566-452b-aefd-f2425d7ef135 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:32.796158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e604e9d2-6d81-4a2e-8e12-f85bf58c8c0b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:32.796929 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e604e9d2-6d81-4a2e-8e12-f85bf58c8c0b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:32.798122 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e604e9d2-6d81-4a2e-8e12-f85bf58c8c0b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:32.798830 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e604e9d2-6d81-4a2e-8e12-f85bf58c8c0b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:32.808356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-01eaf2b8-2566-452b-aefd-f2425d7ef135 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.268854 Jul 04 08:10:32.808952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 433/934] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:32 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:32.993863 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e604e9d2-6d81-4a2e-8e12-f85bf58c8c0b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:33.003307 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e604e9d2-6d81-4a2e-8e12-f85bf58c8c0b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1278 microversion: 2.1 time: 0.222080 Jul 04 08:10:33.004412 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 502/935] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:32 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:33.404276 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:33.405991 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: c5d165c5-1758-4475-b335-7eb6f12f7d3c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:33.416524 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.418105 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.418105 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.418570 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.434531 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] HTTP exception thrown: Instance c5d165c5-1758-4475-b335-7eb6f12f7d3c could not be found. Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Request method failure captured: Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c HTTP/1.1 Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp86y5zB6tJmUvnCBxloMYPfz3Qu1J2vZNvALy11_SGklA0-6zpcp9i-qXZg_aKmNOY0KAVoTThFHL2J5xGD8lKRaA6HbDycVJoWay3Tx1aFQSmAK8oaRsWv5iQSyEwBVsMcnSHDiqUgbMRRPkeTzsn1MKqYqaic2Kn1UZ2Z_VEiH1s Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:10:33.438552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ecd5bc804a3b4f14b864fb4e0f8d1b98", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 9e3f73e469f34b66bfbe99c3d79ac129 Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance c5d165c5-1758-4475-b335-7eb6f12f7d3c could not be found. Jul 04 08:10:33.440476 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': 'c5d165c5-1758-4475-b335-7eb6f12f7d3c'} Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d165c5-1758-4475-b335-7eb6f12f7d3c could not be found. Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:33.441686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d165c5-1758-4475-b335-7eb6f12f7d3c could not be found. Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d165c5-1758-4475-b335-7eb6f12f7d3c could not be found. Jul 04 08:10:33.443552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:33.448762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Returning 404 to user: Instance c5d165c5-1758-4475-b335-7eb6f12f7d3c could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:33.450744 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6e5baa55-0f2e-4f12-b228-d9b913261a80 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c" status: 404 len: 111 microversion: 2.1 time: 0.050192 Jul 04 08:10:33.452387 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 434/936] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:33 2022] GET /compute/v2.1/servers/c5d165c5-1758-4475-b335-7eb6f12f7d3c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:33.464771 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4712baae-8496-4302-a237-7672bde14ef2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:33.466065 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4712baae-8496-4302-a237-7672bde14ef2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:33.479216 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4712baae-8496-4302-a237-7672bde14ef2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.480094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4712baae-8496-4302-a237-7672bde14ef2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.481739 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4712baae-8496-4302-a237-7672bde14ef2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.482596 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4712baae-8496-4302-a237-7672bde14ef2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.524929 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4712baae-8496-4302-a237-7672bde14ef2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:10:33.640898 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4712baae-8496-4302-a237-7672bde14ef2 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "DELETE /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 204 len: 0 microversion: 2.1 time: 0.183767 Jul 04 08:10:33.642015 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 503/937] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:33 2022] DELETE /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:10:33.652524 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2c98040b-a400-4b13-a5ae-c89604a0026b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:33.653138 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2c98040b-a400-4b13-a5ae-c89604a0026b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:33.661424 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c98040b-a400-4b13-a5ae-c89604a0026b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.661910 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c98040b-a400-4b13-a5ae-c89604a0026b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.662714 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c98040b-a400-4b13-a5ae-c89604a0026b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.663146 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2c98040b-a400-4b13-a5ae-c89604a0026b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.778459 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f318d557-f3a0-4516-91c8-d68c5b8a0d4e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:33.779760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f318d557-f3a0-4516-91c8-d68c5b8a0d4e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:33.787940 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f318d557-f3a0-4516-91c8-d68c5b8a0d4e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.788589 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f318d557-f3a0-4516-91c8-d68c5b8a0d4e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.789453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f318d557-f3a0-4516-91c8-d68c5b8a0d4e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.790023 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f318d557-f3a0-4516-91c8-d68c5b8a0d4e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.831419 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f318d557-f3a0-4516-91c8-d68c5b8a0d4e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069488 Jul 04 08:10:33.832755 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 504/938] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:33 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:10:33.839730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9c15095c-d69e-4e0f-ba53-5dce6fece92e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:33.840536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9c15095c-d69e-4e0f-ba53-5dce6fece92e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:33.850578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9c15095c-d69e-4e0f-ba53-5dce6fece92e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.851055 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9c15095c-d69e-4e0f-ba53-5dce6fece92e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.851825 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9c15095c-d69e-4e0f-ba53-5dce6fece92e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.852252 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9c15095c-d69e-4e0f-ba53-5dce6fece92e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.858591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2c98040b-a400-4b13-a5ae-c89604a0026b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:33.869204 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2c98040b-a400-4b13-a5ae-c89604a0026b tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.220454 Jul 04 08:10:33.870706 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 435/939] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:33 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:33.875563 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-46c994c7-8337-4f6a-bf63-d30431819f88 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:33.876166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-46c994c7-8337-4f6a-bf63-d30431819f88 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:33.886148 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46c994c7-8337-4f6a-bf63-d30431819f88 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.886840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46c994c7-8337-4f6a-bf63-d30431819f88 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.888235 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46c994c7-8337-4f6a-bf63-d30431819f88 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.888953 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-46c994c7-8337-4f6a-bf63-d30431819f88 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.890435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9c15095c-d69e-4e0f-ba53-5dce6fece92e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/170fa1a0-c807-4a19-a15b-6bfadb95c5d4" status: 200 len: 194 microversion: 2.1 time: 0.056555 Jul 04 08:10:33.891069 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 505/940] 10.222.0.43 () {58 vars in 1412 bytes} [Mon Jul 4 08:10:33 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/170fa1a0-c807-4a19-a15b-6bfadb95c5d4 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:33.906997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-57722cf8-9c98-438a-92e7-21cd3cde42e5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:33.907638 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-57722cf8-9c98-438a-92e7-21cd3cde42e5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:33.915647 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57722cf8-9c98-438a-92e7-21cd3cde42e5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.916096 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57722cf8-9c98-438a-92e7-21cd3cde42e5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:33.916881 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57722cf8-9c98-438a-92e7-21cd3cde42e5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:33.917313 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57722cf8-9c98-438a-92e7-21cd3cde42e5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:34.004190 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-57722cf8-9c98-438a-92e7-21cd3cde42e5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lazy-loading 'services' on Instance uuid 1fbad2f2-0053-4c22-a052-48d2265b2c6c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:34.051748 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-46c994c7-8337-4f6a-bf63-d30431819f88 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:34.061872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-46c994c7-8337-4f6a-bf63-d30431819f88 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.190866 Jul 04 08:10:34.062453 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 436/941] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:33 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:34.071979 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-44b4197c-12fa-4007-9645-f405fa3de0fb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:34.071979 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-44b4197c-12fa-4007-9645-f405fa3de0fb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:34.075516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-44b4197c-12fa-4007-9645-f405fa3de0fb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:34.076048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-44b4197c-12fa-4007-9645-f405fa3de0fb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:34.076806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-44b4197c-12fa-4007-9645-f405fa3de0fb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:34.077337 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-44b4197c-12fa-4007-9645-f405fa3de0fb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:34.126136 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-57722cf8-9c98-438a-92e7-21cd3cde42e5 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/170fa1a0-c807-4a19-a15b-6bfadb95c5d4" status: 202 len: 0 microversion: 2.1 time: 0.224790 Jul 04 08:10:34.130905 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 506/942] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:10:33 2022] DELETE /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments/170fa1a0-c807-4a19-a15b-6bfadb95c5d4 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 04 08:10:34.138647 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:34.166572 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:34.294586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-44b4197c-12fa-4007-9645-f405fa3de0fb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:34.307520 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-44b4197c-12fa-4007-9645-f405fa3de0fb tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1278 microversion: 2.1 time: 0.243744 Jul 04 08:10:34.308123 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 437/943] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:34 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1278 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:34.842260 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:34.848484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f4e2f6ac-4a76-4565-9b47-2aa346788fc9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:34.849564 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f4e2f6ac-4a76-4565-9b47-2aa346788fc9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:34.857072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f4e2f6ac-4a76-4565-9b47-2aa346788fc9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:34.857879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f4e2f6ac-4a76-4565-9b47-2aa346788fc9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:34.859253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f4e2f6ac-4a76-4565-9b47-2aa346788fc9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:34.860086 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f4e2f6ac-4a76-4565-9b47-2aa346788fc9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:34.891252 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-23100c09-a98e-403f-a607-14d0a1b1d58c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:34.892437 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-23100c09-a98e-403f-a607-14d0a1b1d58c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:34.900441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-23100c09-a98e-403f-a607-14d0a1b1d58c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:34.901048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-23100c09-a98e-403f-a607-14d0a1b1d58c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:34.902086 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-23100c09-a98e-403f-a607-14d0a1b1d58c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:34.902583 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-23100c09-a98e-403f-a607-14d0a1b1d58c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:34.918006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f4e2f6ac-4a76-4565-9b47-2aa346788fc9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077074 Jul 04 08:10:34.919446 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 507/944] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:34 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:35.046886 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-23100c09-a98e-403f-a607-14d0a1b1d58c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:35.055332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-23100c09-a98e-403f-a607-14d0a1b1d58c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.168757 Jul 04 08:10:35.056024 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 438/945] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:34 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:35.079791 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4f0dde7d-a744-433b-a1c1-8a2f4290c7e1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:35.081732 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4f0dde7d-a744-433b-a1c1-8a2f4290c7e1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:35.086892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f0dde7d-a744-433b-a1c1-8a2f4290c7e1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:35.087312 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f0dde7d-a744-433b-a1c1-8a2f4290c7e1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:35.088074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f0dde7d-a744-433b-a1c1-8a2f4290c7e1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:35.088494 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4f0dde7d-a744-433b-a1c1-8a2f4290c7e1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:35.252047 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4f0dde7d-a744-433b-a1c1-8a2f4290c7e1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:35.264512 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4f0dde7d-a744-433b-a1c1-8a2f4290c7e1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.188949 Jul 04 08:10:35.265098 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 508/946] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:35 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:35.325535 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-19e62afa-0d73-4425-b05e-6a9efb7aec2d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:35.327023 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-19e62afa-0d73-4425-b05e-6a9efb7aec2d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:35.335178 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19e62afa-0d73-4425-b05e-6a9efb7aec2d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:35.335927 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19e62afa-0d73-4425-b05e-6a9efb7aec2d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:35.336975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19e62afa-0d73-4425-b05e-6a9efb7aec2d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:35.337427 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-19e62afa-0d73-4425-b05e-6a9efb7aec2d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:35.488311 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-19e62afa-0d73-4425-b05e-6a9efb7aec2d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:35.496342 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-19e62afa-0d73-4425-b05e-6a9efb7aec2d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1278 microversion: 2.1 time: 0.174927 Jul 04 08:10:35.496932 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 439/947] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:35 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1278 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:35.932638 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a671b6d7-19c7-4142-b62f-2384a940e786 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:35.941415 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a671b6d7-19c7-4142-b62f-2384a940e786 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:35.942361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a671b6d7-19c7-4142-b62f-2384a940e786 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:35.942942 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a671b6d7-19c7-4142-b62f-2384a940e786 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:35.944795 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a671b6d7-19c7-4142-b62f-2384a940e786 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:35.944795 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a671b6d7-19c7-4142-b62f-2384a940e786 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:35.984728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a671b6d7-19c7-4142-b62f-2384a940e786 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056360 Jul 04 08:10:35.985242 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 509/948] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:35 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:36.073373 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-20084dda-ff7c-4acd-b34e-376b8506dbee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:36.074150 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-20084dda-ff7c-4acd-b34e-376b8506dbee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:36.081460 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20084dda-ff7c-4acd-b34e-376b8506dbee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:36.081942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20084dda-ff7c-4acd-b34e-376b8506dbee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:36.083210 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20084dda-ff7c-4acd-b34e-376b8506dbee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:36.083678 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-20084dda-ff7c-4acd-b34e-376b8506dbee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:36.248124 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-20084dda-ff7c-4acd-b34e-376b8506dbee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:36.263344 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-20084dda-ff7c-4acd-b34e-376b8506dbee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.193559 Jul 04 08:10:36.264327 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 440/949] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:36 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:36.282695 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-69289ef4-9997-4227-9064-cfd0efb602ea tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:36.283966 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-69289ef4-9997-4227-9064-cfd0efb602ea tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:36.291551 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69289ef4-9997-4227-9064-cfd0efb602ea tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:36.292051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69289ef4-9997-4227-9064-cfd0efb602ea tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:36.292952 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69289ef4-9997-4227-9064-cfd0efb602ea tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:36.293386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69289ef4-9997-4227-9064-cfd0efb602ea tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:36.315273 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:36.465279 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-69289ef4-9997-4227-9064-cfd0efb602ea tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:36.474516 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-69289ef4-9997-4227-9064-cfd0efb602ea tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.195838 Jul 04 08:10:36.475521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 510/950] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:36 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:36.476242 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-a4dc2a3c-5396-42e2-be8e-4f3f1ae3b702 req-b280f5b7-4841-4673-b8a5-4a7ef7e67d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bf7886-bd99-4926-bb03-78d6488963f8", "name": "network-vif-plugged", "status": "completed", "tag": "7b293845-76c3-49eb-ad43-17b180aeee72"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:36.506433 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-a4dc2a3c-5396-42e2-be8e-4f3f1ae3b702 req-b280f5b7-4841-4673-b8a5-4a7ef7e67d17 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:36.507618 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-a4dc2a3c-5396-42e2-be8e-4f3f1ae3b702 req-b280f5b7-4841-4673-b8a5-4a7ef7e67d17 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:36.515219 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-57d57818-e63d-4660-b552-1d7c7400faf6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:36.516047 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-57d57818-e63d-4660-b552-1d7c7400faf6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:36.526304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57d57818-e63d-4660-b552-1d7c7400faf6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:36.527150 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57d57818-e63d-4660-b552-1d7c7400faf6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:36.528048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57d57818-e63d-4660-b552-1d7c7400faf6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:36.528761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57d57818-e63d-4660-b552-1d7c7400faf6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:36.542919 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-a4dc2a3c-5396-42e2-be8e-4f3f1ae3b702 req-b280f5b7-4841-4673-b8a5-4a7ef7e67d17 service nova] Creating event network-vif-plugged:7b293845-76c3-49eb-ad43-17b180aeee72 for instance 52bf7886-bd99-4926-bb03-78d6488963f8 on hv-cinder-79760 Jul 04 08:10:36.561675 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-a4dc2a3c-5396-42e2-be8e-4f3f1ae3b702 req-b280f5b7-4841-4673-b8a5-4a7ef7e67d17 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094659 Jul 04 08:10:36.563908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 441/951] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:10:36.697670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-57d57818-e63d-4660-b552-1d7c7400faf6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:36.706730 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-57d57818-e63d-4660-b552-1d7c7400faf6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1266 microversion: 2.1 time: 0.195856 Jul 04 08:10:36.707373 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 511/952] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:36 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:37.003709 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-be3969ae-91bb-4d91-92a5-ad72b76da3dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:37.005592 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-be3969ae-91bb-4d91-92a5-ad72b76da3dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:37.016495 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be3969ae-91bb-4d91-92a5-ad72b76da3dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:37.017324 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be3969ae-91bb-4d91-92a5-ad72b76da3dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:37.018046 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be3969ae-91bb-4d91-92a5-ad72b76da3dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:37.018556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be3969ae-91bb-4d91-92a5-ad72b76da3dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:37.055702 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-be3969ae-91bb-4d91-92a5-ad72b76da3dc tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058870 Jul 04 08:10:37.056292 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 442/953] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:36 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:37.281491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a2146290-fa25-44bf-88cd-d8f2a74fc5a8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:37.282784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a2146290-fa25-44bf-88cd-d8f2a74fc5a8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:37.290560 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a2146290-fa25-44bf-88cd-d8f2a74fc5a8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:37.291282 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a2146290-fa25-44bf-88cd-d8f2a74fc5a8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:37.292266 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a2146290-fa25-44bf-88cd-d8f2a74fc5a8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:37.292861 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a2146290-fa25-44bf-88cd-d8f2a74fc5a8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:37.492586 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a2146290-fa25-44bf-88cd-d8f2a74fc5a8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:37.493742 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ac4be082-1c86-4dfb-b2e8-f55a13c624b1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:37.494726 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ac4be082-1c86-4dfb-b2e8-f55a13c624b1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:37.503570 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a2146290-fa25-44bf-88cd-d8f2a74fc5a8 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1520 microversion: 2.1 time: 0.226038 Jul 04 08:10:37.508055 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac4be082-1c86-4dfb-b2e8-f55a13c624b1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:37.508506 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac4be082-1c86-4dfb-b2e8-f55a13c624b1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:37.509299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac4be082-1c86-4dfb-b2e8-f55a13c624b1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:37.509757 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ac4be082-1c86-4dfb-b2e8-f55a13c624b1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:37.515080 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 512/954] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:37 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:37.520882 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-29e594c3-06a8-437c-9fca-be363c3e33c7 req-14a64d44-e2c7-4d66-a16e-816ac9ff757a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d58cef-2712-485a-a46d-b96178458181", "name": "network-vif-deleted", "tag": "bc0b4523-5b60-4757-aa81-8ac852d68a9d"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:37.529442 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-29e594c3-06a8-437c-9fca-be363c3e33c7 req-14a64d44-e2c7-4d66-a16e-816ac9ff757a service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:37.529902 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-29e594c3-06a8-437c-9fca-be363c3e33c7 req-14a64d44-e2c7-4d66-a16e-816ac9ff757a service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:37.542584 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-29e594c3-06a8-437c-9fca-be363c3e33c7 req-14a64d44-e2c7-4d66-a16e-816ac9ff757a service nova] Creating event network-vif-deleted:bc0b4523-5b60-4757-aa81-8ac852d68a9d for instance 07d58cef-2712-485a-a46d-b96178458181 on hv-cinder-79760 Jul 04 08:10:37.548821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-29e594c3-06a8-437c-9fca-be363c3e33c7 req-14a64d44-e2c7-4d66-a16e-816ac9ff757a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031892 Jul 04 08:10:37.550054 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 513/955] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:37.654225 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ac4be082-1c86-4dfb-b2e8-f55a13c624b1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:37.662678 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ac4be082-1c86-4dfb-b2e8-f55a13c624b1 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.174504 Jul 04 08:10:37.663287 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 443/956] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:37 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:37.729938 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-10e78d8d-2311-44c1-a6b9-4508920d893b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:37.730650 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-10e78d8d-2311-44c1-a6b9-4508920d893b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:37.740268 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-10e78d8d-2311-44c1-a6b9-4508920d893b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:37.740770 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-10e78d8d-2311-44c1-a6b9-4508920d893b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:37.741651 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-10e78d8d-2311-44c1-a6b9-4508920d893b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:37.742181 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-10e78d8d-2311-44c1-a6b9-4508920d893b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:37.923378 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-10e78d8d-2311-44c1-a6b9-4508920d893b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:37.932367 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-10e78d8d-2311-44c1-a6b9-4508920d893b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1266 microversion: 2.1 time: 0.206882 Jul 04 08:10:37.933195 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 514/957] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:37 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:38.069146 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bfd51580-0d25-442f-9a1b-1162a31d258c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:38.070042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bfd51580-0d25-442f-9a1b-1162a31d258c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:38.076809 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bfd51580-0d25-442f-9a1b-1162a31d258c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:38.077208 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bfd51580-0d25-442f-9a1b-1162a31d258c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:38.078009 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bfd51580-0d25-442f-9a1b-1162a31d258c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:38.078425 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bfd51580-0d25-442f-9a1b-1162a31d258c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:38.115854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bfd51580-0d25-442f-9a1b-1162a31d258c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050753 Jul 04 08:10:38.116922 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 444/958] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:38 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:38.524561 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:38.525531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:38.535621 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:38.536245 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:38.537382 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:38.538065 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:38.575023 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:38.575474 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:38.575895 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'fault' on Instance uuid 07d58cef-2712-485a-a46d-b96178458181 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:38.617287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:38.626609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6d789331-6f79-4b40-b9f7-eec1cb53dcee tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1311 microversion: 2.1 time: 0.107826 Jul 04 08:10:38.628066 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 515/959] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:38 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:38.680552 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-63ca152e-9a32-4f9d-870b-da78c20c4800 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:38.681270 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-63ca152e-9a32-4f9d-870b-da78c20c4800 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:38.688217 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-63ca152e-9a32-4f9d-870b-da78c20c4800 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:38.688727 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-63ca152e-9a32-4f9d-870b-da78c20c4800 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:38.689615 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-63ca152e-9a32-4f9d-870b-da78c20c4800 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:38.690079 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-63ca152e-9a32-4f9d-870b-da78c20c4800 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:38.833730 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-63ca152e-9a32-4f9d-870b-da78c20c4800 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:38.841494 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-63ca152e-9a32-4f9d-870b-da78c20c4800 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.165035 Jul 04 08:10:38.842097 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 445/960] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:38 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:38.950257 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4170e444-d04d-44f1-801f-c341f238dfaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:38.950906 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4170e444-d04d-44f1-801f-c341f238dfaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:38.957166 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4170e444-d04d-44f1-801f-c341f238dfaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:38.957742 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4170e444-d04d-44f1-801f-c341f238dfaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:38.958715 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4170e444-d04d-44f1-801f-c341f238dfaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:38.959146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4170e444-d04d-44f1-801f-c341f238dfaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.123502 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4170e444-d04d-44f1-801f-c341f238dfaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:39.128610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f7c654f0-6e38-489b-8de9-9095e395c4d0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:39.130135 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f7c654f0-6e38-489b-8de9-9095e395c4d0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:39.132204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4170e444-d04d-44f1-801f-c341f238dfaa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1266 microversion: 2.1 time: 0.186303 Jul 04 08:10:39.132989 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 516/961] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:38 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:39.136956 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f7c654f0-6e38-489b-8de9-9095e395c4d0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.137461 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f7c654f0-6e38-489b-8de9-9095e395c4d0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.138387 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f7c654f0-6e38-489b-8de9-9095e395c4d0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.139021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f7c654f0-6e38-489b-8de9-9095e395c4d0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.170129 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f7c654f0-6e38-489b-8de9-9095e395c4d0 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045751 Jul 04 08:10:39.170674 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 446/962] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:39 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 04 08:10:39.228736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-47355925-60c3-4274-917f-5d99c287cae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:39.229232 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-47355925-60c3-4274-917f-5d99c287cae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:39.235576 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47355925-60c3-4274-917f-5d99c287cae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.236030 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47355925-60c3-4274-917f-5d99c287cae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.236820 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47355925-60c3-4274-917f-5d99c287cae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.237248 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47355925-60c3-4274-917f-5d99c287cae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.263650 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-47355925-60c3-4274-917f-5d99c287cae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:10:39.347913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-47355925-60c3-4274-917f-5d99c287cae4 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 204 len: 0 microversion: 2.1 time: 0.122792 Jul 04 08:10:39.348799 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 517/963] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:39 2022] DELETE /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:10:39.358855 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-88f34fb4-f056-4e31-97d4-e6320aa85d7c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:39.359470 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-88f34fb4-f056-4e31-97d4-e6320aa85d7c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:39.366297 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88f34fb4-f056-4e31-97d4-e6320aa85d7c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.366754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88f34fb4-f056-4e31-97d4-e6320aa85d7c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.367769 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88f34fb4-f056-4e31-97d4-e6320aa85d7c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.368120 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88f34fb4-f056-4e31-97d4-e6320aa85d7c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.373682 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:39.509168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-88f34fb4-f056-4e31-97d4-e6320aa85d7c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:39.517732 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-88f34fb4-f056-4e31-97d4-e6320aa85d7c tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1681 microversion: 2.1 time: 0.162900 Jul 04 08:10:39.518343 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 447/964] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:39 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:39.604447 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-945a6702-7dfa-4c3b-9fd1-d82e6bf63bc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:39.605461 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-945a6702-7dfa-4c3b-9fd1-d82e6bf63bc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:39.612425 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-945a6702-7dfa-4c3b-9fd1-d82e6bf63bc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.612866 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-945a6702-7dfa-4c3b-9fd1-d82e6bf63bc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.613767 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-945a6702-7dfa-4c3b-9fd1-d82e6bf63bc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.614265 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-945a6702-7dfa-4c3b-9fd1-d82e6bf63bc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.645818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-945a6702-7dfa-4c3b-9fd1-d82e6bf63bc8 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045632 Jul 04 08:10:39.646097 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:39.646396 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 518/965] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:39 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 08:10:39.646822 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:39.653762 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.654279 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.655460 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.656030 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.687002 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:39.692691 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.693205 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.693693 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'fault' on Instance uuid 07d58cef-2712-485a-a46d-b96178458181 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:39.746421 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:39.755576 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2f5780af-36b0-4ed7-b97c-21a4c742548c tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1311 microversion: 2.1 time: 0.113737 Jul 04 08:10:39.756108 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 448/966] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:39 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:39.776849 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8dcd54fe-f77e-4eee-bf18-5787abf983ba tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:39.777877 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8dcd54fe-f77e-4eee-bf18-5787abf983ba tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:39.784402 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8dcd54fe-f77e-4eee-bf18-5787abf983ba tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.784838 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8dcd54fe-f77e-4eee-bf18-5787abf983ba tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.785800 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8dcd54fe-f77e-4eee-bf18-5787abf983ba tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.786434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8dcd54fe-f77e-4eee-bf18-5787abf983ba tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.815585 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8dcd54fe-f77e-4eee-bf18-5787abf983ba tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043235 Jul 04 08:10:39.816139 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 519/967] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:10:39 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 08:10:39.859718 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c7e49bd8-364d-4845-b953-ed00295dff18 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:39.860465 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c7e49bd8-364d-4845-b953-ed00295dff18 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:39.867396 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c7e49bd8-364d-4845-b953-ed00295dff18 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.867847 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c7e49bd8-364d-4845-b953-ed00295dff18 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.868645 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c7e49bd8-364d-4845-b953-ed00295dff18 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.869067 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c7e49bd8-364d-4845-b953-ed00295dff18 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.876208 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7ae6e254-3abe-4fbb-b133-4da616fefe7e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:39.876926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7ae6e254-3abe-4fbb-b133-4da616fefe7e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:39.883917 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7ae6e254-3abe-4fbb-b133-4da616fefe7e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.884355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7ae6e254-3abe-4fbb-b133-4da616fefe7e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.885124 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7ae6e254-3abe-4fbb-b133-4da616fefe7e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:39.885646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7ae6e254-3abe-4fbb-b133-4da616fefe7e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:39.911394 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7ae6e254-3abe-4fbb-b133-4da616fefe7e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:10:39.997143 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7ae6e254-3abe-4fbb-b133-4da616fefe7e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 204 len: 0 microversion: 2.1 time: 0.125879 Jul 04 08:10:39.998085 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 520/968] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:39 2022] DELETE /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:10:40.006937 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-08b6e51e-af9e-468d-87a5-d6ff396686bf tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:40.007740 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-08b6e51e-af9e-468d-87a5-d6ff396686bf tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:40.010486 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c7e49bd8-364d-4845-b953-ed00295dff18 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:40.013691 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-08b6e51e-af9e-468d-87a5-d6ff396686bf tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:40.014239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-08b6e51e-af9e-468d-87a5-d6ff396686bf tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:40.015120 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-08b6e51e-af9e-468d-87a5-d6ff396686bf tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:40.015432 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-08b6e51e-af9e-468d-87a5-d6ff396686bf tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:40.018177 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c7e49bd8-364d-4845-b953-ed00295dff18 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1575 microversion: 2.1 time: 0.162435 Jul 04 08:10:40.018754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 449/969] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:39 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:40.150666 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ff2389b0-744e-447b-b420-52a371a952a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:40.151272 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ff2389b0-744e-447b-b420-52a371a952a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:40.153384 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-08b6e51e-af9e-468d-87a5-d6ff396686bf tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:40.157923 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff2389b0-744e-447b-b420-52a371a952a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:40.158374 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff2389b0-744e-447b-b420-52a371a952a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:40.159167 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff2389b0-744e-447b-b420-52a371a952a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:40.159597 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ff2389b0-744e-447b-b420-52a371a952a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:40.161650 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-08b6e51e-af9e-468d-87a5-d6ff396686bf tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1673 microversion: 2.1 time: 0.159183 Jul 04 08:10:40.162257 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 521/970] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:40 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:40.296450 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ff2389b0-744e-447b-b420-52a371a952a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:40.304973 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ff2389b0-744e-447b-b420-52a371a952a9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1266 microversion: 2.1 time: 0.158330 Jul 04 08:10:40.305901 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 450/971] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:40 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:40.536944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-da39b52b-07f3-42a8-9168-5f732c6a0180 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:40.537686 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-da39b52b-07f3-42a8-9168-5f732c6a0180 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:40.543889 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da39b52b-07f3-42a8-9168-5f732c6a0180 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:40.544355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da39b52b-07f3-42a8-9168-5f732c6a0180 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:40.545112 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da39b52b-07f3-42a8-9168-5f732c6a0180 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:40.545545 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da39b52b-07f3-42a8-9168-5f732c6a0180 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:40.688450 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da39b52b-07f3-42a8-9168-5f732c6a0180 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:40.696434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-da39b52b-07f3-42a8-9168-5f732c6a0180 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1681 microversion: 2.1 time: 0.163820 Jul 04 08:10:40.696963 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 522/972] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:40 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:40.772772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:40.773332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:40.782333 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:40.782670 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:40.783458 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:40.784130 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:40.818745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:40.819183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:40.819626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lazy-loading 'fault' on Instance uuid 07d58cef-2712-485a-a46d-b96178458181 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:40.880879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e3f73e469f34b66bfbe99c3d79ac129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ecd5bc804a3b4f14b864fb4e0f8d1b98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:40.889770 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-93c341df-1577-4024-b4ba-6bd15c5934e5 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 200 len: 1311 microversion: 2.1 time: 0.120861 Jul 04 08:10:40.890352 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 451/973] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:40 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:41.040651 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-73deb7f3-0c76-4c76-95b4-1177f07a662f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:41.041870 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-73deb7f3-0c76-4c76-95b4-1177f07a662f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:41.051617 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-73deb7f3-0c76-4c76-95b4-1177f07a662f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.052552 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-73deb7f3-0c76-4c76-95b4-1177f07a662f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.056437 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-73deb7f3-0c76-4c76-95b4-1177f07a662f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.056437 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-73deb7f3-0c76-4c76-95b4-1177f07a662f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.180908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-fb5aa034-8d43-4d6b-859d-19f27beacd1a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:41.181519 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-fb5aa034-8d43-4d6b-859d-19f27beacd1a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:41.190984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb5aa034-8d43-4d6b-859d-19f27beacd1a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.192541 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb5aa034-8d43-4d6b-859d-19f27beacd1a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.194100 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb5aa034-8d43-4d6b-859d-19f27beacd1a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.194888 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-fb5aa034-8d43-4d6b-859d-19f27beacd1a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.238907 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-73deb7f3-0c76-4c76-95b4-1177f07a662f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:41.247158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-73deb7f3-0c76-4c76-95b4-1177f07a662f tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1562 microversion: 2.1 time: 0.214285 Jul 04 08:10:41.247736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 523/974] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:41 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1562 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:41.322926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-07bda96e-4b9c-4054-b5aa-18ed0437fd37 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:41.323676 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-07bda96e-4b9c-4054-b5aa-18ed0437fd37 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:41.330493 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07bda96e-4b9c-4054-b5aa-18ed0437fd37 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.330938 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07bda96e-4b9c-4054-b5aa-18ed0437fd37 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.331714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07bda96e-4b9c-4054-b5aa-18ed0437fd37 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.332301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07bda96e-4b9c-4054-b5aa-18ed0437fd37 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.337355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:41.362005 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-fb5aa034-8d43-4d6b-859d-19f27beacd1a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:41.370602 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-fb5aa034-8d43-4d6b-859d-19f27beacd1a tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1673 microversion: 2.1 time: 0.193960 Jul 04 08:10:41.371502 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 452/975] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:41 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1673 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:41.499660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-07bda96e-4b9c-4054-b5aa-18ed0437fd37 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:41.508435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-07bda96e-4b9c-4054-b5aa-18ed0437fd37 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1266 microversion: 2.1 time: 0.189650 Jul 04 08:10:41.509075 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 524/976] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:41 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:41.717586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-498af5c4-4c4d-4ed2-a725-3e5e5721cf3d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:41.718557 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-498af5c4-4c4d-4ed2-a725-3e5e5721cf3d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:41.728278 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-498af5c4-4c4d-4ed2-a725-3e5e5721cf3d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.728926 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-498af5c4-4c4d-4ed2-a725-3e5e5721cf3d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.730129 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-498af5c4-4c4d-4ed2-a725-3e5e5721cf3d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.730781 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-498af5c4-4c4d-4ed2-a725-3e5e5721cf3d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.901370 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-498af5c4-4c4d-4ed2-a725-3e5e5721cf3d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:41.909351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-498af5c4-4c4d-4ed2-a725-3e5e5721cf3d tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1681 microversion: 2.1 time: 0.197992 Jul 04 08:10:41.909980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 453/977] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:41 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:41.915129 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:41.915728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] [instance: 07d58cef-2712-485a-a46d-b96178458181] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:41.922556 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.923002 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.923761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:41.924186 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:41.937884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] HTTP exception thrown: Instance 07d58cef-2712-485a-a46d-b96178458181 could not be found. Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Request method failure captured: Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 HTTP/1.1 Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp86y5zB6tJmUvnCBxloMYPfz3Qu1J2vZNvALy11_SGklA0-6zpcp9i-qXZg_aKmNOY0KAVoTThFHL2J5xGD8lKRaA6HbDycVJoWay3Tx1aFQSmAK8oaRsWv5iQSyEwBVsMcnSHDiqUgbMRRPkeTzsn1MKqYqaic2Kn1UZ2Z_VEiH1s Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:41.939553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/ecd5bc804a3b4f14b864fb4e0f8d1b98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_ecd5bc804a3b4f14b864fb4e0f8d1b98", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: ecd5bc804a3b4f14b864fb4e0f8d1b98 Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-980895259 Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 9e3f73e469f34b66bfbe99c3d79ac129 Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-980895259-project Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 07d58cef-2712-485a-a46d-b96178458181 could not be found. Jul 04 08:10:41.941140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '07d58cef-2712-485a-a46d-b96178458181'} Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07d58cef-2712-485a-a46d-b96178458181 could not be found. Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:41.942215 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07d58cef-2712-485a-a46d-b96178458181 could not be found. Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07d58cef-2712-485a-a46d-b96178458181 could not be found. Jul 04 08:10:41.943769 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:41.945109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] Returning 404 to user: Instance 07d58cef-2712-485a-a46d-b96178458181 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:41.945109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f2fb60f6-3000-46f7-ba2a-a83aa6ada814 tempest-ServerRescueNegativeTestJSON-980895259 tempest-ServerRescueNegativeTestJSON-980895259-project] 10.222.0.43 "GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181" status: 404 len: 111 microversion: 2.1 time: 0.029824 Jul 04 08:10:41.945109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 525/978] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:41 2022] GET /compute/v2.1/servers/07d58cef-2712-485a-a46d-b96178458181 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 08:10:42.398365 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8cd4510a-6021-41a9-b0bb-2b7d3d73803e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:42.399136 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8cd4510a-6021-41a9-b0bb-2b7d3d73803e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:42.405441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cd4510a-6021-41a9-b0bb-2b7d3d73803e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:42.406185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cd4510a-6021-41a9-b0bb-2b7d3d73803e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:42.406944 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cd4510a-6021-41a9-b0bb-2b7d3d73803e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:42.407366 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8cd4510a-6021-41a9-b0bb-2b7d3d73803e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:42.453534 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-8194189c-8073-4373-a01b-f4cd85e7f605 req-4a8cc7e2-92db-4c4c-a7c8-1ac25c9399c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4231e66-b993-47b6-9da6-869b1258d7ed", "name": "network-vif-plugged", "status": "completed", "tag": "65fb0420-dfb3-4fe8-b366-98253c495984"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:42.462654 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-8194189c-8073-4373-a01b-f4cd85e7f605 req-4a8cc7e2-92db-4c4c-a7c8-1ac25c9399c6 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:42.463087 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-8194189c-8073-4373-a01b-f4cd85e7f605 req-4a8cc7e2-92db-4c4c-a7c8-1ac25c9399c6 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:42.477112 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-8194189c-8073-4373-a01b-f4cd85e7f605 req-4a8cc7e2-92db-4c4c-a7c8-1ac25c9399c6 service nova] Creating event network-vif-plugged:65fb0420-dfb3-4fe8-b366-98253c495984 for instance c4231e66-b993-47b6-9da6-869b1258d7ed on hv-cinder-79760 Jul 04 08:10:42.482174 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-8194189c-8073-4373-a01b-f4cd85e7f605 req-4a8cc7e2-92db-4c4c-a7c8-1ac25c9399c6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032309 Jul 04 08:10:42.483105 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 526/979] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:42.527823 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4ecda1df-50e2-4166-bdff-cd76878f634b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:42.528802 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4ecda1df-50e2-4166-bdff-cd76878f634b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:42.536778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4ecda1df-50e2-4166-bdff-cd76878f634b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:42.537236 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4ecda1df-50e2-4166-bdff-cd76878f634b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:42.538253 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4ecda1df-50e2-4166-bdff-cd76878f634b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:42.538683 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4ecda1df-50e2-4166-bdff-cd76878f634b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:42.654050 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8cd4510a-6021-41a9-b0bb-2b7d3d73803e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:42.663253 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8cd4510a-6021-41a9-b0bb-2b7d3d73803e tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1673 microversion: 2.1 time: 0.269182 Jul 04 08:10:42.663859 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 454/980] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:42 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1673 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:42.712463 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4ecda1df-50e2-4166-bdff-cd76878f634b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:42.720961 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4ecda1df-50e2-4166-bdff-cd76878f634b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1266 microversion: 2.1 time: 0.198501 Jul 04 08:10:42.721910 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 527/981] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:42 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:10:42.927483 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a773a25f-991b-468b-a576-e26e36333f97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:42.928334 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a773a25f-991b-468b-a576-e26e36333f97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:42.935443 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a773a25f-991b-468b-a576-e26e36333f97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:42.935977 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a773a25f-991b-468b-a576-e26e36333f97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:42.936787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a773a25f-991b-468b-a576-e26e36333f97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:42.937213 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a773a25f-991b-468b-a576-e26e36333f97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:43.144853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a773a25f-991b-468b-a576-e26e36333f97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:43.154358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a773a25f-991b-468b-a576-e26e36333f97 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1681 microversion: 2.1 time: 0.230981 Jul 04 08:10:43.155220 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 455/982] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:42 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1681 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:43.681095 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-62f4db63-57a5-443c-a8b1-734a1772aeee tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:43.682003 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-62f4db63-57a5-443c-a8b1-734a1772aeee tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:43.689037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62f4db63-57a5-443c-a8b1-734a1772aeee tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:43.689494 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62f4db63-57a5-443c-a8b1-734a1772aeee tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:43.690352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62f4db63-57a5-443c-a8b1-734a1772aeee tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:43.690788 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62f4db63-57a5-443c-a8b1-734a1772aeee tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:43.739110 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4f7028a2-5283-43fa-82d6-d6a0253d91e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:43.740044 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4f7028a2-5283-43fa-82d6-d6a0253d91e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:43.747630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4f7028a2-5283-43fa-82d6-d6a0253d91e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:43.747630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4f7028a2-5283-43fa-82d6-d6a0253d91e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:43.748679 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4f7028a2-5283-43fa-82d6-d6a0253d91e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:43.749384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4f7028a2-5283-43fa-82d6-d6a0253d91e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:43.832353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-62f4db63-57a5-443c-a8b1-734a1772aeee tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:43.841271 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-62f4db63-57a5-443c-a8b1-734a1772aeee tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1673 microversion: 2.1 time: 0.164281 Jul 04 08:10:43.841875 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 528/983] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:43 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:44.177493 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0fda5b5b-355b-49b3-b9ca-c81073819d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:44.178313 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0fda5b5b-355b-49b3-b9ca-c81073819d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:44.185130 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0fda5b5b-355b-49b3-b9ca-c81073819d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:44.185585 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0fda5b5b-355b-49b3-b9ca-c81073819d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:44.186396 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0fda5b5b-355b-49b3-b9ca-c81073819d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:44.186886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0fda5b5b-355b-49b3-b9ca-c81073819d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:44.367341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0fda5b5b-355b-49b3-b9ca-c81073819d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:44.377999 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0fda5b5b-355b-49b3-b9ca-c81073819d04 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1681 microversion: 2.1 time: 0.204290 Jul 04 08:10:44.379877 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 529/984] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:44 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:44.514050 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4f7028a2-5283-43fa-82d6-d6a0253d91e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:44.523029 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4f7028a2-5283-43fa-82d6-d6a0253d91e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1266 microversion: 2.1 time: 0.788162 Jul 04 08:10:44.523612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 456/985] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:43 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1266 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:44.868293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-131c0907-5019-4f0b-9c48-0c125fb42648 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:44.869922 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-131c0907-5019-4f0b-9c48-0c125fb42648 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:44.887915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-131c0907-5019-4f0b-9c48-0c125fb42648 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:44.888726 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-131c0907-5019-4f0b-9c48-0c125fb42648 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:44.890017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-131c0907-5019-4f0b-9c48-0c125fb42648 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:44.891593 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-131c0907-5019-4f0b-9c48-0c125fb42648 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:45.254243 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-131c0907-5019-4f0b-9c48-0c125fb42648 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:45.274490 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-131c0907-5019-4f0b-9c48-0c125fb42648 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1673 microversion: 2.1 time: 0.410025 Jul 04 08:10:45.280646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 530/986] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:44 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1673 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:45.407902 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-642ac42a-1b3d-47f5-a3f5-51cb6deb4ff2 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:45.408841 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-642ac42a-1b3d-47f5-a3f5-51cb6deb4ff2 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:45.422281 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-642ac42a-1b3d-47f5-a3f5-51cb6deb4ff2 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:45.424094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-642ac42a-1b3d-47f5-a3f5-51cb6deb4ff2 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:45.425441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-642ac42a-1b3d-47f5-a3f5-51cb6deb4ff2 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:45.426168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-642ac42a-1b3d-47f5-a3f5-51cb6deb4ff2 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:45.546122 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7cdb2b5d-beb9-4388-bbe0-bb100a6ae86d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:45.548603 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7cdb2b5d-beb9-4388-bbe0-bb100a6ae86d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:45.562878 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cdb2b5d-beb9-4388-bbe0-bb100a6ae86d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:45.563275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-642ac42a-1b3d-47f5-a3f5-51cb6deb4ff2 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:45.566904 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cdb2b5d-beb9-4388-bbe0-bb100a6ae86d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:45.570828 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cdb2b5d-beb9-4388-bbe0-bb100a6ae86d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:45.572305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cdb2b5d-beb9-4388-bbe0-bb100a6ae86d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:45.587530 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-642ac42a-1b3d-47f5-a3f5-51cb6deb4ff2 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1614 microversion: 2.1 time: 0.185851 Jul 04 08:10:45.590345 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 457/987] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:45 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1614 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:45.871079 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-89a06a0f-c1f0-46da-bd0f-9d1ada99420c req-b3dc7493-6238-43c9-a198-1f541b83f50f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4b07442-ab28-4f72-8fbd-36f683a8f50c", "name": "network-vif-deleted", "tag": "c51aca95-0a5f-4a71-85e2-e526a34214aa"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:45.903530 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-89a06a0f-c1f0-46da-bd0f-9d1ada99420c req-b3dc7493-6238-43c9-a198-1f541b83f50f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:45.904860 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-89a06a0f-c1f0-46da-bd0f-9d1ada99420c req-b3dc7493-6238-43c9-a198-1f541b83f50f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:45.929344 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7cdb2b5d-beb9-4388-bbe0-bb100a6ae86d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:45.949231 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7cdb2b5d-beb9-4388-bbe0-bb100a6ae86d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1266 microversion: 2.1 time: 0.409316 Jul 04 08:10:45.959436 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-89a06a0f-c1f0-46da-bd0f-9d1ada99420c req-b3dc7493-6238-43c9-a198-1f541b83f50f service nova] Creating event network-vif-deleted:c51aca95-0a5f-4a71-85e2-e526a34214aa for instance a4b07442-ab28-4f72-8fbd-36f683a8f50c on hv-cinder-79760 Jul 04 08:10:45.963278 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 531/988] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:45 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1266 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:45.975996 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-89a06a0f-c1f0-46da-bd0f-9d1ada99420c req-b3dc7493-6238-43c9-a198-1f541b83f50f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117727 Jul 04 08:10:45.977159 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 458/989] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:10:46.308197 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:46.310842 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:46.328797 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:46.329983 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:46.330807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:46.331314 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:46.382937 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:46.384011 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:46.384482 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lazy-loading 'fault' on Instance uuid 1fbad2f2-0053-4c22-a052-48d2265b2c6c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:46.451956 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18b1072539af49729dff7ee9ea445c77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a4b394ba684ed2a67d14b4a5b24f2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:46.465926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-087f02f8-4e30-4991-a003-5d3b578fd56d tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 200 len: 1327 microversion: 2.1 time: 0.171623 Jul 04 08:10:46.466972 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 532/990] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:46 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 1327 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:46.608565 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:46.611131 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:46.624914 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:46.626154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:46.628355 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:46.638494 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:46.700463 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:46.701235 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:46.702186 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lazy-loading 'fault' on Instance uuid a4b07442-ab28-4f72-8fbd-36f683a8f50c {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:10:46.862521 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126ba607541e4c4895b47b4b7602ce01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5226d001fb47b399172b6633fec844', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:46.875953 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-08e4e544-5b1d-47dc-8241-7f45e82b6a42 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 200 len: 1330 microversion: 2.1 time: 0.271945 Jul 04 08:10:46.880961 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 459/991] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:46 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 1330 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:46.971912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-755c75a0-8121-4e72-957a-f4945ddc23dc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:46.974707 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-755c75a0-8121-4e72-957a-f4945ddc23dc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:46.992646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-755c75a0-8121-4e72-957a-f4945ddc23dc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:46.994130 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-755c75a0-8121-4e72-957a-f4945ddc23dc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:46.996255 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-755c75a0-8121-4e72-957a-f4945ddc23dc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:46.999172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-755c75a0-8121-4e72-957a-f4945ddc23dc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:47.390173 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-755c75a0-8121-4e72-957a-f4945ddc23dc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:47.399828 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-755c75a0-8121-4e72-957a-f4945ddc23dc tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1454 microversion: 2.1 time: 0.437106 Jul 04 08:10:47.400628 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 533/992] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:46 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1454 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:47.442477 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-77ba3005-e2c4-49ac-998c-99df240d8b74 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:47.443290 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-77ba3005-e2c4-49ac-998c-99df240d8b74 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:47.454218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-77ba3005-e2c4-49ac-998c-99df240d8b74 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:47.455864 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-77ba3005-e2c4-49ac-998c-99df240d8b74 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:47.459078 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-77ba3005-e2c4-49ac-998c-99df240d8b74 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:47.462459 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-77ba3005-e2c4-49ac-998c-99df240d8b74 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:47.499754 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:47.502917 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:47.516411 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:47.529594 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:47.531045 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:47.532808 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:47.534158 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:47.563401 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] HTTP exception thrown: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Request method failure captured: Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c HTTP/1.1 Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7c93-U7Fc6zr2rEoMiT6zeB6n68PvZs_1ezjOBvg6I68sX2bGuy1_lQ6R_JrLmxEOoN1ACL2peE-9FNMBuTEmEBqBMAQr_KWXr3oweCf4HxEYrMOK5gIqUL8f28w8rEQ7HOJofDQrDVs1ReKgwEbN0kSNniI8rFI8frRKTQpVlMrI Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:47.565183 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34a4b394ba684ed2a67d14b4a5b24f2f", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 18b1072539af49729dff7ee9ea445c77 Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:47.567171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '1fbad2f2-0053-4c22-a052-48d2265b2c6c'} Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:47.567984 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:47.569960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:47.572034 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Returning 404 to user: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:47.572034 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-df0d88fb-a03e-47dc-bb37-a398d2a9f02f tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 404 len: 111 microversion: 2.1 time: 0.077826 Jul 04 08:10:47.576496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 534/993] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:47 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:47.583230 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e9a7635f-2cd5-4c47-bc27-95d22fe4b382 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '.version_select at 0x7f05e5697a60>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:47.606048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e9a7635f-2cd5-4c47-bc27-95d22fe4b382 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363695053" status: 202 len: 0 microversion: 2.1 time: 0.028202 Jul 04 08:10:47.606681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 535/994] 10.222.0.43 () {58 vars in 1220 bytes} [Mon Jul 4 08:10:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363695053 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:10:47.813279 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-77ba3005-e2c4-49ac-998c-99df240d8b74 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:47.822734 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-77ba3005-e2c4-49ac-998c-99df240d8b74 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1454 microversion: 2.1 time: 0.400933 Jul 04 08:10:47.838915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 460/995] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:47 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1454 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:47.902138 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:47.902764 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:47.934919 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:47.935918 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:47.941600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:47.941600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:48.017115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c HTTP/1.1 Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:48.023453 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:48.025664 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': 'a4b07442-ab28-4f72-8fbd-36f683a8f50c'} Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:48.026853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:48.028484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:48.034400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:48.035628 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ecea6536-8f60-484c-a075-34047d228d7e tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 404 len: 111 microversion: 2.1 time: 0.140305 Jul 04 08:10:48.036869 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 536/996] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:47 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:48.046124 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-872bec85-2350-4642-9657-f05530318fd3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '.version_select at 0x7f05e550c310>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:48.087218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-872bec85-2350-4642-9657-f05530318fd3 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-495000353" status: 202 len: 0 microversion: 2.1 time: 0.045192 Jul 04 08:10:48.091138 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 461/997] 10.222.0.43 () {58 vars in 1217 bytes} [Mon Jul 4 08:10:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-495000353 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:10:48.115960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-990439d0-0223-401f-b82e-d31292155da0 req-f85914e4-7ff3-4c2f-a535-3b0ae27e6580 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbad2f2-0053-4c22-a052-48d2265b2c6c", "name": "network-vif-deleted", "tag": "86e0ac73-22b7-4a2b-b97c-c96f71ac308a"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:48.127916 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-990439d0-0223-401f-b82e-d31292155da0 req-f85914e4-7ff3-4c2f-a535-3b0ae27e6580 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:48.131619 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-990439d0-0223-401f-b82e-d31292155da0 req-f85914e4-7ff3-4c2f-a535-3b0ae27e6580 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:48.147608 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-990439d0-0223-401f-b82e-d31292155da0 req-f85914e4-7ff3-4c2f-a535-3b0ae27e6580 service nova] Creating event network-vif-deleted:86e0ac73-22b7-4a2b-b97c-c96f71ac308a for instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c on hv-cinder-79760 Jul 04 08:10:48.153299 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-990439d0-0223-401f-b82e-d31292155da0 req-f85914e4-7ff3-4c2f-a535-3b0ae27e6580 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048258 Jul 04 08:10:48.154532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 537/998] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:51.043957 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-12d2cb89-a002-4240-a706-2006d2ba1c27 req-097d157f-6c2f-4663-936c-21809c006796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4231e66-b993-47b6-9da6-869b1258d7ed", "tag": "65fb0420-dfb3-4fe8-b366-98253c495984"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:10:51.062814 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-12d2cb89-a002-4240-a706-2006d2ba1c27 req-097d157f-6c2f-4663-936c-21809c006796 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:51.063579 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-12d2cb89-a002-4240-a706-2006d2ba1c27 req-097d157f-6c2f-4663-936c-21809c006796 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:51.077959 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-12d2cb89-a002-4240-a706-2006d2ba1c27 req-097d157f-6c2f-4663-936c-21809c006796 service nova] Creating event network-changed:65fb0420-dfb3-4fe8-b366-98253c495984 for instance c4231e66-b993-47b6-9da6-869b1258d7ed on hv-cinder-79760 Jul 04 08:10:51.083544 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-12d2cb89-a002-4240-a706-2006d2ba1c27 req-097d157f-6c2f-4663-936c-21809c006796 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044489 Jul 04 08:10:51.084393 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 462/999] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:10:51.158542 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:51.159129 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:51.171585 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:51.172038 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:51.172819 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:51.173281 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:51.200051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c HTTP/1.1 Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:51.203892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.205553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': 'a4b07442-ab28-4f72-8fbd-36f683a8f50c'} Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:51.206554 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.209010 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.220942 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:51.224005 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4b5c1aa5-fe02-495d-a08e-904d8fc87f8f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 404 len: 111 microversion: 2.1 time: 0.069736 Jul 04 08:10:51.226864 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 538/1000] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:51 2022] DELETE /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:51.236803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:51.237769 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: a4b07442-ab28-4f72-8fbd-36f683a8f50c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:51.248502 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:51.250722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:51.251960 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:51.252928 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:51.324588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c HTTP/1.1 Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:10:51.327423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.329019 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': 'a4b07442-ab28-4f72-8fbd-36f683a8f50c'} Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:51.329934 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. Jul 04 08:10:51.331849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:51.337491 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance a4b07442-ab28-4f72-8fbd-36f683a8f50c could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:51.341127 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-106a801d-02e0-41f4-92db-9a4fa2cd721f tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c" status: 404 len: 111 microversion: 2.1 time: 0.108512 Jul 04 08:10:51.343351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 463/1001] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:51 2022] GET /compute/v2.1/servers/a4b07442-ab28-4f72-8fbd-36f683a8f50c => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:52.435031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:52.435852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:52.445920 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.446367 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.447144 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.447575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.462532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] HTTP exception thrown: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Request method failure captured: Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c HTTP/1.1 Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7c93-U7Fc6zr2rEoMiT6zeB6n68PvZs_1ezjOBvg6I68sX2bGuy1_lQ6R_JrLmxEOoN1ACL2peE-9FNMBuTEmEBqBMAQr_KWXr3oweCf4HxEYrMOK5gIqUL8f28w8rEQ7HOJofDQrDVs1ReKgwEbN0kSNniI8rFI8frRKTQpVlMrI Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:52.464353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34a4b394ba684ed2a67d14b4a5b24f2f", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 18b1072539af49729dff7ee9ea445c77 Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.465854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '1fbad2f2-0053-4c22-a052-48d2265b2c6c'} Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:52.466674 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.467921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.469162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Returning 404 to user: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:52.469162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-53aabc8e-ef1b-4862-b9d6-7e7ca4f393e2 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 404 len: 111 microversion: 2.1 time: 0.039073 Jul 04 08:10:52.469162 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 539/1002] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:52 2022] DELETE /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 08:10:52.475456 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:52.476058 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 1fbad2f2-0053-4c22-a052-48d2265b2c6c] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:52.483605 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.484310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.485337 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.485797 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.504394 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] HTTP exception thrown: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Request method failure captured: Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c HTTP/1.1 Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7c93-U7Fc6zr2rEoMiT6zeB6n68PvZs_1ezjOBvg6I68sX2bGuy1_lQ6R_JrLmxEOoN1ACL2peE-9FNMBuTEmEBqBMAQr_KWXr3oweCf4HxEYrMOK5gIqUL8f28w8rEQ7HOJofDQrDVs1ReKgwEbN0kSNniI8rFI8frRKTQpVlMrI Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:10:52.506017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34a4b394ba684ed2a67d14b4a5b24f2f", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 18b1072539af49729dff7ee9ea445c77 Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.507660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '1fbad2f2-0053-4c22-a052-48d2265b2c6c'} Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:52.508509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. Jul 04 08:10:52.509970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.512892 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Returning 404 to user: Instance 1fbad2f2-0053-4c22-a052-48d2265b2c6c could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:52.514395 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-75c1d69d-7a63-4c6d-aef2-a3dd39ffd374 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c" status: 404 len: 111 microversion: 2.1 time: 0.043650 Jul 04 08:10:52.515671 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 464/1003] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:52 2022] GET /compute/v2.1/servers/1fbad2f2-0053-4c22-a052-48d2265b2c6c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:52.521271 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:52.522501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:52.530060 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.530557 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.531532 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.532106 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.549565 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d HTTP/1.1 Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:52.551247 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.552818 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '7d9919b8-5ba1-4472-b2cc-1faabba0742d'} Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:52.553813 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.555039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.556351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:52.556351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1583e23d-5025-47a3-9945-84f0e5b171a9 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 404 len: 111 microversion: 2.1 time: 0.036477 Jul 04 08:10:52.557760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 540/1004] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:52 2022] DELETE /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:52.562862 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:52.563483 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 7d9919b8-5ba1-4472-b2cc-1faabba0742d] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:52.570695 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.571146 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.572016 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.572688 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.589048 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d HTTP/1.1 Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:10:52.590758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.592630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '7d9919b8-5ba1-4472-b2cc-1faabba0742d'} Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:52.593559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. Jul 04 08:10:52.595626 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.597540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance 7d9919b8-5ba1-4472-b2cc-1faabba0742d could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:52.597540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-db5058c7-1135-4a21-b510-59610e6ac4ec tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d" status: 404 len: 111 microversion: 2.1 time: 0.033323 Jul 04 08:10:52.597540 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 465/1005] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:52 2022] GET /compute/v2.1/servers/7d9919b8-5ba1-4472-b2cc-1faabba0742d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:52.603266 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:52.604054 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:52.610483 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.610921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.611724 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.612152 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.628790 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 HTTP/1.1 Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:52.630503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.631944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '4dfe5154-5465-4c6b-a6c0-d41f8fcfb545'} Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:52.632712 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.634009 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.635352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:52.635352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c291b87b-4c55-4bf8-b316-0ac8f78831d5 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 404 len: 111 microversion: 2.1 time: 0.034290 Jul 04 08:10:52.635352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 541/1006] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:52 2022] DELETE /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:52.641743 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:52.642351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:52.648724 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.649166 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.649960 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:52.650383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:52.667382 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 HTTP/1.1 Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:10:52.668918 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.670546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '4dfe5154-5465-4c6b-a6c0-d41f8fcfb545'} Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:52.671375 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. Jul 04 08:10:52.672604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:52.673745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance 4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:52.673745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-81dd3149-e174-4d3a-9e65-8899ba777aae tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545" status: 404 len: 111 microversion: 2.1 time: 0.032692 Jul 04 08:10:52.673745 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 466/1007] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:52 2022] GET /compute/v2.1/servers/4dfe5154-5465-4c6b-a6c0-d41f8fcfb545 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:53.683802 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:53.684729 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:53.691349 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:53.691864 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:53.692694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:53.693127 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:53.707603 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] HTTP exception thrown: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Request method failure captured: Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f HTTP/1.1 Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7c93-U7Fc6zr2rEoMiT6zeB6n68PvZs_1ezjOBvg6I68sX2bGuy1_lQ6R_JrLmxEOoN1ACL2peE-9FNMBuTEmEBqBMAQr_KWXr3oweCf4HxEYrMOK5gIqUL8f28w8rEQ7HOJofDQrDVs1ReKgwEbN0kSNniI8rFI8frRKTQpVlMrI Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:53.709270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34a4b394ba684ed2a67d14b4a5b24f2f", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 18b1072539af49729dff7ee9ea445c77 Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.710772 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '3b415c8c-45f0-4469-82d4-a3b8c3c6145f'} Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:53.714599 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.716074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.717553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Returning 404 to user: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:53.717553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bfb5180c-3fae-44fa-a967-b21d42e87b57 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 404 len: 111 microversion: 2.1 time: 0.031211 Jul 04 08:10:53.717553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 542/1008] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:53 2022] DELETE /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:53.719286 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:53.719878 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] [instance: 3b415c8c-45f0-4469-82d4-a3b8c3c6145f] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:53.726196 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:53.726630 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:53.727410 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:53.727873 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:53.741664 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] HTTP exception thrown: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Request method failure captured: Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f HTTP/1.1 Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7c93-U7Fc6zr2rEoMiT6zeB6n68PvZs_1ezjOBvg6I68sX2bGuy1_lQ6R_JrLmxEOoN1ACL2peE-9FNMBuTEmEBqBMAQr_KWXr3oweCf4HxEYrMOK5gIqUL8f28w8rEQ7HOJofDQrDVs1ReKgwEbN0kSNniI8rFI8frRKTQpVlMrI Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:10:53.743190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/34a4b394ba684ed2a67d14b4a5b24f2f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_34a4b394ba684ed2a67d14b4a5b24f2f", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 34a4b394ba684ed2a67d14b4a5b24f2f Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1327600433 Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 18b1072539af49729dff7ee9ea445c77 Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeTestJSON-1327600433-project Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.745187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '3b415c8c-45f0-4469-82d4-a3b8c3c6145f'} Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:53.746275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. Jul 04 08:10:53.747784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.749109 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] Returning 404 to user: Instance 3b415c8c-45f0-4469-82d4-a3b8c3c6145f could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:53.749109 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bbffef7a-f93e-4366-ab44-f6362d860458 tempest-AttachVolumeTestJSON-1327600433 tempest-AttachVolumeTestJSON-1327600433-project] 10.222.0.43 "GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f" status: 404 len: 111 microversion: 2.1 time: 0.029153 Jul 04 08:10:53.749109 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 467/1009] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:53 2022] GET /compute/v2.1/servers/3b415c8c-45f0-4469-82d4-a3b8c3c6145f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:53.819435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:53.820042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:53.827751 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:53.828386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:53.829210 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:53.829781 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:53.846640 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 HTTP/1.1 Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:10:53.848330 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.849854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '3ce6703a-43b5-47a0-8d17-1794e718e3b1'} Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:53.850775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.852172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.854477 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:53.854477 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d186371d-5203-4cac-af81-5b4bf4a10f9b tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "DELETE /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 404 len: 111 microversion: 2.1 time: 0.037606 Jul 04 08:10:53.857982 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 543/1010] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:10:53 2022] DELETE /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:10:53.863757 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:53.864809 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] [instance: 3ce6703a-43b5-47a0-8d17-1794e718e3b1] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:53.872827 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:53.873328 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:53.874183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:53.874615 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:53.889392 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] HTTP exception thrown: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Request method failure captured: Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 HTTP/1.1 Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7ctV-sUgMVL46Vrq2d2FfxsR_yGe7pPsH3e9B-icLrU2eM7MKpPLN8VIZ9Yshy2cxi07JJRG2tpaLEZoGCG64R4g0vrvQKeiQiV6HZt0EnOhvVG0SS8IS2hKpmlFf32A92EuZevQL2IldA_qb0HcwvSXNEhV_tFpTF_4yHYuX4Lno Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:10:53.890963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/de5226d001fb47b399172b6633fec844"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/de5226d001fb47b399172b6633fec844"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_de5226d001fb47b399172b6633fec844", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: de5226d001fb47b399172b6633fec844 Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1582009138 Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 126ba607541e4c4895b47b4b7602ce01 Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeNegativeTest-1582009138-project Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.892571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '3ce6703a-43b5-47a0-8d17-1794e718e3b1'} Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:10:53.893806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. Jul 04 08:10:53.895332 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:10:53.896830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] Returning 404 to user: Instance 3ce6703a-43b5-47a0-8d17-1794e718e3b1 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:10:53.896830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-099b0a4f-8595-4419-914d-56410d115c71 tempest-AttachVolumeNegativeTest-1582009138 tempest-AttachVolumeNegativeTest-1582009138-project] 10.222.0.43 "GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1" status: 404 len: 111 microversion: 2.1 time: 0.033316 Jul 04 08:10:53.896830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 468/1011] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:10:53 2022] GET /compute/v2.1/servers/3ce6703a-43b5-47a0-8d17-1794e718e3b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 08:10:57.457072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b4d8cfad-9604-4a8a-92d9-ab15a19568ba tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:57.458244 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b4d8cfad-9604-4a8a-92d9-ab15a19568ba tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:57.467736 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4d8cfad-9604-4a8a-92d9-ab15a19568ba tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:57.468345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4d8cfad-9604-4a8a-92d9-ab15a19568ba tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:57.469293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4d8cfad-9604-4a8a-92d9-ab15a19568ba tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:57.470487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4d8cfad-9604-4a8a-92d9-ab15a19568ba tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:57.509755 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b4d8cfad-9604-4a8a-92d9-ab15a19568ba tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057873 Jul 04 08:10:57.518590 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 544/1012] 10.222.0.43 () {60 vars in 1342 bytes} [Mon Jul 4 08:10:57 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:10:57.634732 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-04e00bbf-c778-4a93-9b66-6c0317418a6d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:57.635891 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-04e00bbf-c778-4a93-9b66-6c0317418a6d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:57.643758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04e00bbf-c778-4a93-9b66-6c0317418a6d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:57.644707 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04e00bbf-c778-4a93-9b66-6c0317418a6d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:57.645679 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04e00bbf-c778-4a93-9b66-6c0317418a6d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:57.646266 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-04e00bbf-c778-4a93-9b66-6c0317418a6d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:57.679803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=100 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:10:57.691442 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-04e00bbf-c778-4a93-9b66-6c0317418a6d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:10:57.828256 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-04e00bbf-c778-4a93-9b66-6c0317418a6d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 204 len: 0 microversion: 2.20 time: 0.198263 Jul 04 08:10:57.830050 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 469/1013] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Jul 4 08:10:57 2022] DELETE /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 08:10:57.838749 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:57.839271 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:57.846164 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:57.847031 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:57.847946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:57.848446 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:58.116213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:58.126269 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:58.128930 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:58.130701 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d85e0a83-b605-4bec-8b39-dbfc4fcff6f7 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.296077 Jul 04 08:10:58.131804 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 545/1014] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:57 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 04 08:10:59.152226 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:10:59.153436 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:10:59.166409 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:59.167371 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:59.170439 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:10:59.171346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:10:59.568955 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:59.583455 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:59.585278 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:10:59.587582 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9f86ef60-7820-4db2-8f30-40cdf47581c9 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1726 microversion: 2.20 time: 0.439668 Jul 04 08:10:59.587582 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 470/1015] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:10:59 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1726 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:11:00.608292 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:00.610589 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:00.619316 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:00.620072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:00.621425 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:00.622106 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:00.701241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:00.710756 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:00.713970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1501eb69e0a447ce83baa5bdee770d1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fadf5b15f7e43b4bd2372f22b293518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:00.716245 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-83c47831-3439-4f4f-889f-62f688d4278d tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 200 len: 1658 microversion: 2.20 time: 0.112479 Jul 04 08:11:00.717180 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 546/1016] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:11:00 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 1658 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 04 08:11:00.810642 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-74af2b81-9e85-49cf-b645-27636763cbfe req-fbd6e3e2-0945-4f0f-9d5e-83d504811ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb350cf-6a02-4ede-be92-0a7863bc0475", "name": "network-vif-deleted", "tag": "b71d89e6-8615-4c4e-8651-e32f4872be93"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:00.841447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-74af2b81-9e85-49cf-b645-27636763cbfe req-fbd6e3e2-0945-4f0f-9d5e-83d504811ae6 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:00.842127 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-74af2b81-9e85-49cf-b645-27636763cbfe req-fbd6e3e2-0945-4f0f-9d5e-83d504811ae6 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:00.874850 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-74af2b81-9e85-49cf-b645-27636763cbfe req-fbd6e3e2-0945-4f0f-9d5e-83d504811ae6 service nova] Creating event network-vif-deleted:b71d89e6-8615-4c4e-8651-e32f4872be93 for instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 on hv-cinder-79760 Jul 04 08:11:00.887238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-74af2b81-9e85-49cf-b645-27636763cbfe req-fbd6e3e2-0945-4f0f-9d5e-83d504811ae6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086525 Jul 04 08:11:00.887856 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 471/1017] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:01.497089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b56cb73e-0669-417e-ab37-5bfa8d86c824 tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] Action: 'create', calling method: .version_select at 0x7f05e56e0670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-220903437", "metadata": {"Type": "work"}}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:01.738466 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:01.739350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:01.753388 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:01.763298 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:01.766783 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:01.767251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:01.793132 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] HTTP exception thrown: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Request method failure captured: Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 HTTP/1.1 Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7kJk9qe9Y9rYx_iaxMq2EmAP7Gs8jeagCNXWtkwNNq5u0mV8VHqyQ_-FwVajKqoYjiJG3KS-B45QxckxMJkEH09OW0D1uJQ9bP2ZIoTOOANzdTG8WREkEZ9kFBrdC9IJ2O1nSBky6r2aXRngwD4SmNZkPUxD9YEJEz2qcWSIDrodc Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:11:01.794909 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fadf5b15f7e43b4bd2372f22b293518", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 1501eb69e0a447ce83baa5bdee770d1f Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:01.796963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '5eb350cf-6a02-4ede-be92-0a7863bc0475'} Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:01.798356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:01.799999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:01.801661 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Returning 404 to user: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:01.801661 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-230160d1-e134-4a37-8b80-d41ddc3a82dc tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 404 len: 111 microversion: 2.20 time: 0.063877 Jul 04 08:11:01.801661 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 472/1018] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:11:01 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:11:01.806267 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-db89652b-ddfd-4391-8918-d0983e84c1b4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '.version_select at 0x7f05e550cd30>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:01.827720 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-db89652b-ddfd-4391-8918-d0983e84c1b4 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259868001" status: 204 len: 0 microversion: 2.20 time: 0.025430 Jul 04 08:11:01.828605 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 473/1019] 10.222.0.43 () {60 vars in 1261 bytes} [Mon Jul 4 08:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259868001 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 04 08:11:01.996873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b56cb73e-0669-417e-ab37-5bfa8d86c824 tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.945483 Jul 04 08:11:01.998119 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 547/1020] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Jul 4 08:11:01 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 947 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 04 08:11:02.021676 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b843cf94-81fc-4a9c-8f6d-3b05ffe74136 tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] Calling method '.version_select at 0x7f05e5601280>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:02.100606 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b843cf94-81fc-4a9c-8f6d-3b05ffe74136 tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f" status: 200 len: 352 microversion: 2.1 time: 0.093139 Jul 04 08:11:02.101147 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 474/1021] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:11:02 2022] GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f => generated 352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:03.114575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-537dfea9-1aca-4d09-8fd0-24539f73ab1e tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] Calling method '.version_select at 0x7f05e550ac10>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:03.177747 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-537dfea9-1aca-4d09-8fd0-24539f73ab1e tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f" status: 200 len: 353 microversion: 2.1 time: 0.068668 Jul 04 08:11:03.178475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 548/1022] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:11:03 2022] GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f => generated 353 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:03.191619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a343bbfe-b108-42bd-a166-e017f878053a tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] Calling method '.version_select at 0x7f05e56db820>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:03.245609 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a343bbfe-b108-42bd-a166-e017f878053a tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f" status: 200 len: 353 microversion: 2.1 time: 0.058934 Jul 04 08:11:03.246604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 475/1023] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:11:03 2022] GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f => generated 353 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:03.264480 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-da27989a-e61a-4dcb-9cf2-951842bcbcd9 tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] Calling method '.version_select at 0x7f05e5694e50>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:03.341857 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-da27989a-e61a-4dcb-9cf2-951842bcbcd9 tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f" status: 202 len: 0 microversion: 2.1 time: 0.084924 Jul 04 08:11:03.342443 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 549/1024] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:11:03 2022] DELETE /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:11:03.351239 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e068e4a2-7acc-44d0-886b-23100725f622 tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] Calling method '.version_select at 0x7f05e550c310>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:03.409079 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e068e4a2-7acc-44d0-886b-23100725f622 tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f" status: 200 len: 352 microversion: 2.1 time: 0.061933 Jul 04 08:11:03.409945 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 476/1025] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:11:03 2022] GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:03.759434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:03.760167 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:03.767692 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:03.768145 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:03.768917 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:03.769349 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:03.783906 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] HTTP exception thrown: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Request method failure captured: Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 HTTP/1.1 Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7kJk9qe9Y9rYx_iaxMq2EmAP7Gs8jeagCNXWtkwNNq5u0mV8VHqyQ_-FwVajKqoYjiJG3KS-B45QxckxMJkEH09OW0D1uJQ9bP2ZIoTOOANzdTG8WREkEZ9kFBrdC9IJ2O1nSBky6r2aXRngwD4SmNZkPUxD9YEJEz2qcWSIDrodc Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:11:03.785536 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fadf5b15f7e43b4bd2372f22b293518", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 1501eb69e0a447ce83baa5bdee770d1f Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.787228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '5eb350cf-6a02-4ede-be92-0a7863bc0475'} Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:03.788140 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.789366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.790786 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Returning 404 to user: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:03.790786 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d9a678b1-ad4b-401f-be1b-297e8bb23100 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 404 len: 111 microversion: 2.20 time: 0.032608 Jul 04 08:11:03.790786 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 550/1026] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Jul 4 08:11:03 2022] DELETE /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:11:03.796776 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:03.797725 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: 5eb350cf-6a02-4ede-be92-0a7863bc0475] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:03.804757 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:03.805194 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:03.806083 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:03.806549 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:03.820755 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] HTTP exception thrown: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Request method failure captured: Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 HTTP/1.1 Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7kJk9qe9Y9rYx_iaxMq2EmAP7Gs8jeagCNXWtkwNNq5u0mV8VHqyQ_-FwVajKqoYjiJG3KS-B45QxckxMJkEH09OW0D1uJQ9bP2ZIoTOOANzdTG8WREkEZ9kFBrdC9IJ2O1nSBky6r2aXRngwD4SmNZkPUxD9YEJEz2qcWSIDrodc Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:11:03.822772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fadf5b15f7e43b4bd2372f22b293518", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 1501eb69e0a447ce83baa5bdee770d1f Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.824369 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '5eb350cf-6a02-4ede-be92-0a7863bc0475'} Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:03.825164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. Jul 04 08:11:03.826441 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:03.828315 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Returning 404 to user: Instance 5eb350cf-6a02-4ede-be92-0a7863bc0475 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:03.829338 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b47906ae-4c40-4a8e-a8f0-21cddda262d1 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475" status: 404 len: 111 microversion: 2.20 time: 0.036777 Jul 04 08:11:03.830102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 477/1027] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:11:03 2022] GET /compute/v2.1/servers/5eb350cf-6a02-4ede-be92-0a7863bc0475 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 04 08:11:04.422678 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c12f7a5c-7991-4dc3-9996-751f07a457ed tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] Calling method '.version_select at 0x7f05e55d3c10>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:04.458958 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-c12f7a5c-7991-4dc3-9996-751f07a457ed tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] HTTP exception thrown: Volume e8cb7b98-392e-41f0-860f-33f109a69f6f could not be found. Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c12f7a5c-7991-4dc3-9996-751f07a457ed tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] Request method failure captured: Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f HTTP/1.1 Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwqCUNAnUMFQwE-JFwN1L0q90pV6vb41Z3BhoJiSoX9Ec5ujeO4-0d2-dmh7LsKF7zq4Bv_IwbYR5TeySTTs7hKdoJJFxziGRZt4JDtyNJ_Cj2iUvmmWxy9Wo3Hw2qVAABXotZuNYdjdCrV38stpmtUg__Lbx_wRqn3VKhlkjjXpoyYQ Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 457cb5c290ec41f7bdddc8e97b76288f Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesGetTestJSON-2036852374 Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:11:04.461089 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/457cb5c290ec41f7bdddc8e97b76288f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/457cb5c290ec41f7bdddc8e97b76288f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/457cb5c290ec41f7bdddc8e97b76288f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_457cb5c290ec41f7bdddc8e97b76288f", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesGetTestJSON-2036852374 Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 457cb5c290ec41f7bdddc8e97b76288f Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesGetTestJSON-2036852374 Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesGetTestJSON-2036852374-project Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 8ac3a9d78c844e0199ce6ee58e1ff9e6 Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesGetTestJSON-2036852374-project Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Volume e8cb7b98-392e-41f0-860f-33f109a69f6f could not be found. Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': 'e8cb7b98-392e-41f0-860f-33f109a69f6f'} Jul 04 08:11:04.466852 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e8cb7b98-392e-41f0-860f-33f109a69f6f could not be found. (HTTP 404) (Request-ID: req-69d1c654-6875-4dde-9691-84a9ce4a9ab9) Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:04.468024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:11:04.469501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e8cb7b98-392e-41f0-860f-33f109a69f6f could not be found. Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 08:11:04.471051 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e8cb7b98-392e-41f0-860f-33f109a69f6f could not be found. Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e8cb7b98-392e-41f0-860f-33f109a69f6f could not be found. Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c12f7a5c-7991-4dc3-9996-751f07a457ed tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] Returning 404 to user: Volume e8cb7b98-392e-41f0-860f-33f109a69f6f could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c12f7a5c-7991-4dc3-9996-751f07a457ed tempest-VolumesGetTestJSON-2036852374 tempest-VolumesGetTestJSON-2036852374-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f" status: 404 len: 109 microversion: 2.1 time: 0.045274 Jul 04 08:11:04.472274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 551/1028] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:11:04 2022] GET /compute/v2.1/os-volumes/e8cb7b98-392e-41f0-860f-33f109a69f6f => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:11:04.991213 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:04.991861 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:05.001056 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:05.001727 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:05.002964 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:05.003500 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:05.020173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] HTTP exception thrown: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Request method failure captured: Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: DELETE /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af HTTP/1.1 Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp7kJk9qe9Y9rYx_iaxMq2EmAP7Gs8jeagCNXWtkwNNq5u0mV8VHqyQ_-FwVajKqoYjiJG3KS-B45QxckxMJkEH09OW0D1uJQ9bP2ZIoTOOANzdTG8WREkEZ9kFBrdC9IJ2O1nSBky6r2aXRngwD4SmNZkPUxD9YEJEz2qcWSIDrodc Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:11:05.023077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fadf5b15f7e43b4bd2372f22b293518", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 1501eb69e0a447ce83baa5bdee770d1f Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.024586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': 'a42c331b-8c2a-4f37-bd0a-7221b07bf3af'} Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:05.025658 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.027772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.030518 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Returning 404 to user: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:05.030518 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6c4cee46-774a-473b-98a0-8e5aae77f340 tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 404 len: 111 microversion: 2.20 time: 0.041205 Jul 04 08:11:05.030518 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 478/1029] 10.222.0.43 () {60 vars in 1279 bytes} [Mon Jul 4 08:11:04 2022] DELETE /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:11:05.037946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:05.040171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] [instance: a42c331b-8c2a-4f37-bd0a-7221b07bf3af] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:05.047270 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:05.047787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:05.048745 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:05.049408 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:05.066398 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] HTTP exception thrown: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Request method failure captured: Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af HTTP/1.1 Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp7kJk9qe9Y9rYx_iaxMq2EmAP7Gs8jeagCNXWtkwNNq5u0mV8VHqyQ_-FwVajKqoYjiJG3KS-B45QxckxMJkEH09OW0D1uJQ9bP2ZIoTOOANzdTG8WREkEZ9kFBrdC9IJ2O1nSBky6r2aXRngwD4SmNZkPUxD9YEJEz2qcWSIDrodc Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Openstack-Nova-Api-Version: 2.20 Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:11:05.067885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/4fadf5b15f7e43b4bd2372f22b293518"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_4fadf5b15f7e43b4bd2372f22b293518", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 4fadf5b15f7e43b4bd2372f22b293518 Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-96042563 Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 1501eb69e0a447ce83baa5bdee770d1f Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-96042563-project Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.071475 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': 'a42c331b-8c2a-4f37-bd0a-7221b07bf3af'} Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:05.073939 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. Jul 04 08:11:05.077079 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:05.080357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] Returning 404 to user: Instance a42c331b-8c2a-4f37-bd0a-7221b07bf3af could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:05.080357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cda10046-d24f-434f-9050-66711a37668f tempest-AttachVolumeShelveTestJSON-96042563 tempest-AttachVolumeShelveTestJSON-96042563-project] 10.222.0.43 "GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af" status: 404 len: 111 microversion: 2.20 time: 0.035344 Jul 04 08:11:05.080357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 552/1030] 10.222.0.43 () {60 vars in 1276 bytes} [Mon Jul 4 08:11:05 2022] GET /compute/v2.1/servers/a42c331b-8c2a-4f37-bd0a-7221b07bf3af => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:11:08.290576 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-20002ec9-009e-472a-8400-063b2ff4af8c tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e5641280>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:08.366141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-20002ec9-009e-472a-8400-063b2ff4af8c tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/84b632cc-85fd-458d-90f2-6d3c3071bdf7" status: 200 len: 351 microversion: 2.1 time: 0.083004 Jul 04 08:11:08.381374 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 479/1031] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:11:08 2022] GET /compute/v2.1/os-volumes/84b632cc-85fd-458d-90f2-6d3c3071bdf7 => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:09.910739 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5d4dafc6-e9d0-43ef-8a0e-f81462d150bc tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e55d3670>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:10.004867 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5d4dafc6-e9d0-43ef-8a0e-f81462d150bc tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/434f3edf-85b3-4fd9-9fbd-70ad36401508" status: 200 len: 351 microversion: 2.1 time: 0.099158 Jul 04 08:11:10.006078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 553/1032] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:11:09 2022] GET /compute/v2.1/os-volumes/434f3edf-85b3-4fd9-9fbd-70ad36401508 => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:11.628389 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ea9a29fc-00d0-42c3-81e6-6adc8ce61d27 tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e5527c10>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:11.702026 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ea9a29fc-00d0-42c3-81e6-6adc8ce61d27 tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/cbde1bf9-320b-409f-95ea-d8602a4078f7" status: 200 len: 351 microversion: 2.1 time: 0.078754 Jul 04 08:11:11.702980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 480/1033] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:11:11 2022] GET /compute/v2.1/os-volumes/cbde1bf9-320b-409f-95ea-d8602a4078f7 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:11.721442 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b8e63ada-9ddb-41d5-9f19-6cf425496a79 tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e55c3b80>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:11.837037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b8e63ada-9ddb-41d5-9f19-6cf425496a79 tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.124206 Jul 04 08:11:11.849083 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 554/1034] 10.222.0.43 () {58 vars in 1133 bytes} [Mon Jul 4 08:11:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:11.856532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-49e381fa-59bd-4b0d-804c-69f152a8feda tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e756caf0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:11.976958 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-49e381fa-59bd-4b0d-804c-69f152a8feda tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.125573 Jul 04 08:11:11.982140 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 481/1035] 10.222.0.43 () {58 vars in 1148 bytes} [Mon Jul 4 08:11:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:11:11.995735 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b781de2d-5db9-4c35-932f-a007b1383b4a tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e5694b80>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:12.145992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b781de2d-5db9-4c35-932f-a007b1383b4a tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.157791 Jul 04 08:11:12.147023 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 555/1036] 10.222.0.43 () {58 vars in 1133 bytes} [Mon Jul 4 08:11:11 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:11:12.161221 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6f519a25-0b43-492b-9cf4-b649417425cf tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e550c820>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:12.251921 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6f519a25-0b43-492b-9cf4-b649417425cf tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094449 Jul 04 08:11:12.253042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 482/1037] 10.222.0.43 () {58 vars in 1166 bytes} [Mon Jul 4 08:11:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:12.269342 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5e8f6b21-6cef-4871-8087-7447bbbf7bd6 tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e550a9d0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:12.363102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5e8f6b21-6cef-4871-8087-7447bbbf7bd6 tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.097393 Jul 04 08:11:12.363864 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 556/1038] 10.222.0.43 () {58 vars in 1169 bytes} [Mon Jul 4 08:11:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:12.380559 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a567ac74-f5a4-4f68-b98b-881cb54c78ed tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e553e4c0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:12.468849 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a567ac74-f5a4-4f68-b98b-881cb54c78ed tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.096008 Jul 04 08:11:12.469434 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 483/1039] 10.222.0.43 () {58 vars in 1154 bytes} [Mon Jul 4 08:11:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:11:12.481318 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fa734287-79d5-4c75-9183-92f79e0d83e1 tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e56e08b0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:12.619248 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fa734287-79d5-4c75-9183-92f79e0d83e1 tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.141791 Jul 04 08:11:12.620371 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 557/1040] 10.222.0.43 () {58 vars in 1187 bytes} [Mon Jul 4 08:11:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:12.632888 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1a712093-1d1c-43a3-b8de-c2c689cee84c tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] Calling method '.version_select at 0x7f05e550c940>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:12.724916 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1a712093-1d1c-43a3-b8de-c2c689cee84c tempest-VolumesTestJSON-1186565704 tempest-VolumesTestJSON-1186565704-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.096344 Jul 04 08:11:12.725705 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 484/1041] 10.222.0.43 () {58 vars in 1154 bytes} [Mon Jul 4 08:11:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:19.257917 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:19.258853 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=92 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:19.591480 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-768f90c0-d251-4d69-b6bf-e862b899b6e9 tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Action: 'create', calling method: .version_select at 0x7f05e5694310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-23215978", "metadata": {"Type": "work"}}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-768f90c0-d251-4d69-b6bf-e862b899b6e9 tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Request method failure captured: Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 120 Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwqCnWIge-9lOaE-FsFMm9QzL7Wze8buieMhmgc8OdbTnHhthrVA089Cdrp0MYzaHu8s7NVwSAfrkjCrjlFau04g9dJwC2LKnJelmDz4jwkx_-pwdk--KqfNAcq9IOzFigScFHfC5Obk3xZiWnyNVRZPXo6D-HicWucK3c1g4XpwqZfg Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:11:19.611361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f9a0deda992f4b0baf070be5563587c1", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 0801fb7efa4642c180c0006a1970b654 Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-23215978", "metadata": {"Type": "work"}}} Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: Jul 04 08:11:19.613326 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-23215978', 'metadata': {'Type': 'work'}}}} Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise error Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi '#$%' Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:19.614345 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 08:11:19.616149 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 08:11:19.617491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 04 08:11:19.617491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.617491 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-768f90c0-d251-4d69-b6bf-e862b899b6e9 tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:19.624420 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-768f90c0-d251-4d69-b6bf-e862b899b6e9 tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.357244 Jul 04 08:11:19.625083 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 558/1042] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Jul 4 08:11:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 369 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:11:19.637897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4c2bb87f-8f5a-4bee-92ff-f1c9cb4f18dd tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Action: 'create', calling method: .version_select at 0x7f05e5527550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1321181576", "metadata": {"Type": "work"}}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4c2bb87f-8f5a-4bee-92ff-f1c9cb4f18dd tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Request method failure captured: Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 120 Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwqCnWIge-9lOaE-FsFMm9QzL7Wze8buieMhmgc8OdbTnHhthrVA089Cdrp0MYzaHu8s7NVwSAfrkjCrjlFau04g9dJwC2LKnJelmDz4jwkx_-pwdk--KqfNAcq9IOzFigScFHfC5Obk3xZiWnyNVRZPXo6D-HicWucK3c1g4XpwqZfg Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:11:19.642613 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f9a0deda992f4b0baf070be5563587c1", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 0801fb7efa4642c180c0006a1970b654 Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1321181576", "metadata": {"Type": "work"}}} Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: Jul 04 08:11:19.644359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1321181576', 'metadata': {'Type': 'work'}}}} Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise error Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi '0' Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:19.645346 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 08:11:19.646954 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 08:11:19.648299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 04 08:11:19.648299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.648299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4c2bb87f-8f5a-4bee-92ff-f1c9cb4f18dd tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:19.648299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4c2bb87f-8f5a-4bee-92ff-f1c9cb4f18dd tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013863 Jul 04 08:11:19.649159 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 485/1043] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Jul 4 08:11:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:11:19.659353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab991d28-4860-41ee-9344-3fe21d3e891c tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Action: 'create', calling method: .version_select at 0x7f05e5694040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-678852432", "metadata": {"Type": "work"}}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab991d28-4860-41ee-9344-3fe21d3e891c tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Request method failure captured: Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 118 Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwqCnWIge-9lOaE-FsFMm9QzL7Wze8buieMhmgc8OdbTnHhthrVA089Cdrp0MYzaHu8s7NVwSAfrkjCrjlFau04g9dJwC2LKnJelmDz4jwkx_-pwdk--KqfNAcq9IOzFigScFHfC5Obk3xZiWnyNVRZPXo6D-HicWucK3c1g4XpwqZfg Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:11:19.662574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f9a0deda992f4b0baf070be5563587c1", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 0801fb7efa4642c180c0006a1970b654 Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-678852432", "metadata": {"Type": "work"}}} Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: Jul 04 08:11:19.664495 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-678852432', 'metadata': {'Type': 'work'}}}} Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise error Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi '' Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:19.665744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 04 08:11:19.667435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 04 08:11:19.668884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 04 08:11:19.668884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.668884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab991d28-4860-41ee-9344-3fe21d3e891c tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:19.668884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ab991d28-4860-41ee-9344-3fe21d3e891c tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] 10.222.0.43 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009310 Jul 04 08:11:19.668884 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 559/1044] 10.222.0.43 () {60 vars in 1155 bytes} [Mon Jul 4 08:11:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 04 08:11:19.672776 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:19.674420 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:19.680959 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6113e9bb-3fa5-4dd7-a37d-09dd4451713d tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Calling method '.version_select at 0x7f05e5527280>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:19.717261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-6113e9bb-3fa5-4dd7-a37d-09dd4451713d tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] HTTP exception thrown: Volume tempest-invalid-596415711 could not be found. Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6113e9bb-3fa5-4dd7-a37d-09dd4451713d tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Request method failure captured: Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-596415711 HTTP/1.1 Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwqCnWIge-9lOaE-FsFMm9QzL7Wze8buieMhmgc8OdbTnHhthrVA089Cdrp0MYzaHu8s7NVwSAfrkjCrjlFau04g9dJwC2LKnJelmDz4jwkx_-pwdk--KqfNAcq9IOzFigScFHfC5Obk3xZiWnyNVRZPXo6D-HicWucK3c1g4XpwqZfg Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:11:19.719840 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f9a0deda992f4b0baf070be5563587c1", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 0801fb7efa4642c180c0006a1970b654 Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Volume tempest-invalid-596415711 could not be found. Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': 'tempest-invalid-596415711'} Jul 04 08:11:19.721534 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-596415711 could not be found. (HTTP 404) (Request-ID: req-8a1409b1-0eaf-4ab4-868c-263fb9b13d59) Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.722527 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 08:11:19.723738 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-596415711 could not be found. Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:19.724984 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-596415711 could not be found. Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-596415711 could not be found. Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6113e9bb-3fa5-4dd7-a37d-09dd4451713d tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Returning 404 to user: Volume tempest-invalid-596415711 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6113e9bb-3fa5-4dd7-a37d-09dd4451713d tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/tempest-invalid-596415711" status: 404 len: 98 microversion: 2.1 time: 0.050619 Jul 04 08:11:19.726261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 486/1045] 10.222.0.43 () {58 vars in 1214 bytes} [Mon Jul 4 08:11:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-596415711 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 04 08:11:19.735484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0b12c7a6-280e-4594-8cc2-1bc62226069f tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005437 Jul 04 08:11:19.736006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 560/1046] 10.222.0.43 () {58 vars in 1139 bytes} [Mon Jul 4 08:11:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 04 08:11:19.745781 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9389db8c-21a5-47b2-9e46-8ded0162848f tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004086 Jul 04 08:11:19.746310 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 487/1047] 10.222.0.43 () {58 vars in 1136 bytes} [Mon Jul 4 08:11:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 04 08:11:19.756324 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-153af775-b335-4820-a6d5-1799b99fcb25 tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Calling method '.version_select at 0x7f05e56e0f70>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:19.794516 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-153af775-b335-4820-a6d5-1799b99fcb25 tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] HTTP exception thrown: Volume 89bec5a3-965f-43c0-9f29-583457bff5b2 could not be found. Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-153af775-b335-4820-a6d5-1799b99fcb25 tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Request method failure captured: Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/os-volumes/89bec5a3-965f-43c0-9f29-583457bff5b2 HTTP/1.1 Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwqCnWIge-9lOaE-FsFMm9QzL7Wze8buieMhmgc8OdbTnHhthrVA089Cdrp0MYzaHu8s7NVwSAfrkjCrjlFau04g9dJwC2LKnJelmDz4jwkx_-pwdk--KqfNAcq9IOzFigScFHfC5Obk3xZiWnyNVRZPXo6D-HicWucK3c1g4XpwqZfg Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:11:19.797078 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f9a0deda992f4b0baf070be5563587c1", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 0801fb7efa4642c180c0006a1970b654 Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Volume 89bec5a3-965f-43c0-9f29-583457bff5b2 could not be found. Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '89bec5a3-965f-43c0-9f29-583457bff5b2'} Jul 04 08:11:19.798521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89bec5a3-965f-43c0-9f29-583457bff5b2 could not be found. (HTTP 404) (Request-ID: req-8739661c-c7bc-49c1-99db-167b27497709) Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.799496 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 04 08:11:19.800974 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89bec5a3-965f-43c0-9f29-583457bff5b2 could not be found. Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 04 08:11:19.802354 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89bec5a3-965f-43c0-9f29-583457bff5b2 could not be found. Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89bec5a3-965f-43c0-9f29-583457bff5b2 could not be found. Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-153af775-b335-4820-a6d5-1799b99fcb25 tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Returning 404 to user: Volume 89bec5a3-965f-43c0-9f29-583457bff5b2 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:19.803913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-153af775-b335-4820-a6d5-1799b99fcb25 tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] 10.222.0.43 "DELETE /compute/v2.1/os-volumes/89bec5a3-965f-43c0-9f29-583457bff5b2" status: 404 len: 109 microversion: 2.1 time: 0.046532 Jul 04 08:11:19.808904 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-56bd95f0-9559-4407-9f12-3a394ab9594e tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Calling method '.version_select at 0x7f05e5582040>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:19.809795 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 561/1048] 10.222.0.43 () {58 vars in 1247 bytes} [Mon Jul 4 08:11:19 2022] DELETE /compute/v2.1/os-volumes/89bec5a3-965f-43c0-9f29-583457bff5b2 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:11:19.845608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-56bd95f0-9559-4407-9f12-3a394ab9594e tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] HTTP exception thrown: Volume f8f4a85c-0d6a-4484-94d5-423a3d8b7e62 could not be found. Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-56bd95f0-9559-4407-9f12-3a394ab9594e tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Request method failure captured: Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/os-volumes/f8f4a85c-0d6a-4484-94d5-423a3d8b7e62 HTTP/1.1 Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwqCnWIge-9lOaE-FsFMm9QzL7Wze8buieMhmgc8OdbTnHhthrVA089Cdrp0MYzaHu8s7NVwSAfrkjCrjlFau04g9dJwC2LKnJelmDz4jwkx_-pwdk--KqfNAcq9IOzFigScFHfC5Obk3xZiWnyNVRZPXo6D-HicWucK3c1g4XpwqZfg Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:11:19.848367 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/f9a0deda992f4b0baf070be5563587c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_f9a0deda992f4b0baf070be5563587c1", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: f9a0deda992f4b0baf070be5563587c1 Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-VolumesNegativeTest-978617342 Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: 0801fb7efa4642c180c0006a1970b654 Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-VolumesNegativeTest-978617342-project Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Volume f8f4a85c-0d6a-4484-94d5-423a3d8b7e62 could not be found. Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': 'f8f4a85c-0d6a-4484-94d5-423a3d8b7e62'} Jul 04 08:11:19.850112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8f4a85c-0d6a-4484-94d5-423a3d8b7e62 could not be found. (HTTP 404) (Request-ID: req-1ebcc1c6-4029-4fb8-856e-51d1161b7124) Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.851787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 04 08:11:19.853321 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8f4a85c-0d6a-4484-94d5-423a3d8b7e62 could not be found. Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 04 08:11:19.855765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8f4a85c-0d6a-4484-94d5-423a3d8b7e62 could not be found. Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8f4a85c-0d6a-4484-94d5-423a3d8b7e62 could not be found. Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-56bd95f0-9559-4407-9f12-3a394ab9594e tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] Returning 404 to user: Volume f8f4a85c-0d6a-4484-94d5-423a3d8b7e62 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-56bd95f0-9559-4407-9f12-3a394ab9594e tempest-VolumesNegativeTest-978617342 tempest-VolumesNegativeTest-978617342-project] 10.222.0.43 "GET /compute/v2.1/os-volumes/f8f4a85c-0d6a-4484-94d5-423a3d8b7e62" status: 404 len: 109 microversion: 2.1 time: 0.045066 Jul 04 08:11:19.857111 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 488/1049] 10.222.0.43 () {58 vars in 1244 bytes} [Mon Jul 4 08:11:19 2022] GET /compute/v2.1/os-volumes/f8f4a85c-0d6a-4484-94d5-423a3d8b7e62 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:11:22.848525 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-849569001", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "networks": [{"uuid": "6e7898bc-de9c-493f-9736-0a99ce014a8c"}]}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:22.942926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] validate_networks() for [('6e7898bc-de9c-493f-9736-0a99ce014a8c', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:11:23.439417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:11:23.444241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:11:23.444241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:11:23.444241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:11:23.444241 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:11:23.453366 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:23.453850 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:23.454646 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:23.455087 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:23.473745 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Getting quotas for project bfb2bf1afead415b9d6ee79ad836197d. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:11:23.478547 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Getting quotas for user 0224639fe5d24820bdead1bba468ddda and project bfb2bf1afead415b9d6ee79ad836197d. Resources: {'cores', 'instances', 'ram'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:11:23.490649 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:11:23.493661 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:11:23.543718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-da562177-3832-4cd2-a08f-3cf2cf0b1e01 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699409 Jul 04 08:11:23.543718 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 562/1050] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:11:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 04 08:11:23.559071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f0765326-5700-4f2a-865d-4512436ae600 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:23.559071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f0765326-5700-4f2a-865d-4512436ae600 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:23.622424 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f0765326-5700-4f2a-865d-4512436ae600 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:23.630049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f0765326-5700-4f2a-865d-4512436ae600 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1213 microversion: 2.1 time: 0.079512 Jul 04 08:11:23.630716 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 489/1051] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:23 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:24.653222 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-edbbff22-d07a-49b1-ac92-49b4a48b91b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:24.654069 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-edbbff22-d07a-49b1-ac92-49b4a48b91b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:24.661578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edbbff22-d07a-49b1-ac92-49b4a48b91b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:24.662032 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edbbff22-d07a-49b1-ac92-49b4a48b91b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:24.663050 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edbbff22-d07a-49b1-ac92-49b4a48b91b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:24.663503 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edbbff22-d07a-49b1-ac92-49b4a48b91b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:24.731839 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-edbbff22-d07a-49b1-ac92-49b4a48b91b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:24.741153 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-edbbff22-d07a-49b1-ac92-49b4a48b91b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1217 microversion: 2.1 time: 0.093447 Jul 04 08:11:24.741840 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 563/1052] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:24 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1217 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:25.762050 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b05d217e-0f35-41f4-8bc7-47165c286b98 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:25.763603 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b05d217e-0f35-41f4-8bc7-47165c286b98 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:25.776374 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b05d217e-0f35-41f4-8bc7-47165c286b98 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:25.777133 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b05d217e-0f35-41f4-8bc7-47165c286b98 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:25.778160 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b05d217e-0f35-41f4-8bc7-47165c286b98 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:25.778646 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b05d217e-0f35-41f4-8bc7-47165c286b98 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:25.900325 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b05d217e-0f35-41f4-8bc7-47165c286b98 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:25.911694 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b05d217e-0f35-41f4-8bc7-47165c286b98 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1273 microversion: 2.1 time: 0.155213 Jul 04 08:11:25.914121 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 490/1053] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:25 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:26.930404 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ae2e8d41-2255-4f0b-a4d8-8e5daec4ca81 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:26.931071 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ae2e8d41-2255-4f0b-a4d8-8e5daec4ca81 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:26.943945 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ae2e8d41-2255-4f0b-a4d8-8e5daec4ca81 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:26.944879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ae2e8d41-2255-4f0b-a4d8-8e5daec4ca81 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:26.946837 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ae2e8d41-2255-4f0b-a4d8-8e5daec4ca81 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:26.947286 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ae2e8d41-2255-4f0b-a4d8-8e5daec4ca81 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:27.205541 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ae2e8d41-2255-4f0b-a4d8-8e5daec4ca81 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:27.214081 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ae2e8d41-2255-4f0b-a4d8-8e5daec4ca81 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1313 microversion: 2.1 time: 0.287622 Jul 04 08:11:27.215246 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 564/1054] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:26 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:27.656146 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-3b291648-93b7-4c55-8d70-bedd0a95df13 req-7ccfd62d-de86-4228-8f46-a79bc7baedd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85ecef4-02fa-4c4b-a172-172f3836b010", "tag": "105ec75a-d71c-415e-b0bc-e1e5b3cef180"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:27.672915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3b291648-93b7-4c55-8d70-bedd0a95df13 req-7ccfd62d-de86-4228-8f46-a79bc7baedd8 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:27.673643 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-3b291648-93b7-4c55-8d70-bedd0a95df13 req-7ccfd62d-de86-4228-8f46-a79bc7baedd8 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:27.698189 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-3b291648-93b7-4c55-8d70-bedd0a95df13 req-7ccfd62d-de86-4228-8f46-a79bc7baedd8 service nova] Creating event network-changed:105ec75a-d71c-415e-b0bc-e1e5b3cef180 for instance c85ecef4-02fa-4c4b-a172-172f3836b010 on hv-cinder-79760 Jul 04 08:11:27.706276 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-3b291648-93b7-4c55-8d70-bedd0a95df13 req-7ccfd62d-de86-4228-8f46-a79bc7baedd8 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057382 Jul 04 08:11:27.707356 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 491/1055] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:28.232863 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1fc9efdb-9d4a-4f95-b1db-db72addb1794 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:28.233598 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1fc9efdb-9d4a-4f95-b1db-db72addb1794 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:28.240879 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1fc9efdb-9d4a-4f95-b1db-db72addb1794 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:28.241435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1fc9efdb-9d4a-4f95-b1db-db72addb1794 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:28.242104 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1fc9efdb-9d4a-4f95-b1db-db72addb1794 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:28.242924 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1fc9efdb-9d4a-4f95-b1db-db72addb1794 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:28.449506 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1fc9efdb-9d4a-4f95-b1db-db72addb1794 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:28.463638 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1fc9efdb-9d4a-4f95-b1db-db72addb1794 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1313 microversion: 2.1 time: 0.234634 Jul 04 08:11:28.471455 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 565/1056] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:28 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:29.486283 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bd1f3c84-0a65-4b8e-be5b-96b0db187ab2 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:29.487182 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bd1f3c84-0a65-4b8e-be5b-96b0db187ab2 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:29.496251 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd1f3c84-0a65-4b8e-be5b-96b0db187ab2 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:29.496731 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd1f3c84-0a65-4b8e-be5b-96b0db187ab2 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:29.497735 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd1f3c84-0a65-4b8e-be5b-96b0db187ab2 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:29.498170 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd1f3c84-0a65-4b8e-be5b-96b0db187ab2 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:29.682393 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bd1f3c84-0a65-4b8e-be5b-96b0db187ab2 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:29.693987 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bd1f3c84-0a65-4b8e-be5b-96b0db187ab2 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1313 microversion: 2.1 time: 0.212835 Jul 04 08:11:29.694893 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 492/1057] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:29 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:30.712673 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-edf98ecf-d0b3-4d6a-a48b-6ae469325e52 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:30.713361 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-edf98ecf-d0b3-4d6a-a48b-6ae469325e52 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:30.720762 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edf98ecf-d0b3-4d6a-a48b-6ae469325e52 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:30.721540 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edf98ecf-d0b3-4d6a-a48b-6ae469325e52 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:30.723371 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edf98ecf-d0b3-4d6a-a48b-6ae469325e52 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:30.724057 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edf98ecf-d0b3-4d6a-a48b-6ae469325e52 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:30.921470 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-edf98ecf-d0b3-4d6a-a48b-6ae469325e52 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:30.933467 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-edf98ecf-d0b3-4d6a-a48b-6ae469325e52 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1313 microversion: 2.1 time: 0.225256 Jul 04 08:11:30.935026 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 566/1058] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:30 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:31.952015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bd15b15c-03a4-4652-bfa6-caa2c569d966 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:31.952629 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bd15b15c-03a4-4652-bfa6-caa2c569d966 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:31.962556 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd15b15c-03a4-4652-bfa6-caa2c569d966 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:31.963550 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd15b15c-03a4-4652-bfa6-caa2c569d966 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:31.964942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd15b15c-03a4-4652-bfa6-caa2c569d966 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:31.965894 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bd15b15c-03a4-4652-bfa6-caa2c569d966 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:32.136405 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bd15b15c-03a4-4652-bfa6-caa2c569d966 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:32.144713 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bd15b15c-03a4-4652-bfa6-caa2c569d966 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1313 microversion: 2.1 time: 0.196726 Jul 04 08:11:32.145319 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 493/1059] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:31 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:11:33.165035 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-604f3566-2998-4653-a871-e2b9006c8584 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:33.165993 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-604f3566-2998-4653-a871-e2b9006c8584 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:33.188403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-604f3566-2998-4653-a871-e2b9006c8584 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:33.189487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-604f3566-2998-4653-a871-e2b9006c8584 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:33.194164 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-604f3566-2998-4653-a871-e2b9006c8584 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:33.196921 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-604f3566-2998-4653-a871-e2b9006c8584 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:33.383569 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-604f3566-2998-4653-a871-e2b9006c8584 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:33.393556 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-604f3566-2998-4653-a871-e2b9006c8584 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1313 microversion: 2.1 time: 0.235428 Jul 04 08:11:33.394578 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 567/1060] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:33 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:34.414278 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-17fea17b-ce63-41b8-a249-387598225f59 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:34.416261 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-17fea17b-ce63-41b8-a249-387598225f59 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:34.426960 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:34.431760 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-17fea17b-ce63-41b8-a249-387598225f59 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:34.433281 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-17fea17b-ce63-41b8-a249-387598225f59 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:34.435085 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-17fea17b-ce63-41b8-a249-387598225f59 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:34.436628 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-17fea17b-ce63-41b8-a249-387598225f59 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:34.715737 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-17fea17b-ce63-41b8-a249-387598225f59 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:34.724958 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-17fea17b-ce63-41b8-a249-387598225f59 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1313 microversion: 2.1 time: 0.315540 Jul 04 08:11:34.726168 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 494/1061] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:34 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:11:34.915801 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-08e3d8f6-2005-49a0-89da-29ab2ac46408 req-cfd4852b-5fca-4048-8667-aae554484f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85ecef4-02fa-4c4b-a172-172f3836b010", "name": "network-vif-plugged", "status": "completed", "tag": "105ec75a-d71c-415e-b0bc-e1e5b3cef180"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:34.929261 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:34.930887 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:34.935470 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-08e3d8f6-2005-49a0-89da-29ab2ac46408 req-cfd4852b-5fca-4048-8667-aae554484f01 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:34.936151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-08e3d8f6-2005-49a0-89da-29ab2ac46408 req-cfd4852b-5fca-4048-8667-aae554484f01 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:34.954695 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-08e3d8f6-2005-49a0-89da-29ab2ac46408 req-cfd4852b-5fca-4048-8667-aae554484f01 service nova] Creating event network-vif-plugged:105ec75a-d71c-415e-b0bc-e1e5b3cef180 for instance c85ecef4-02fa-4c4b-a172-172f3836b010 on hv-cinder-79760 Jul 04 08:11:34.963212 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-08e3d8f6-2005-49a0-89da-29ab2ac46408 req-cfd4852b-5fca-4048-8667-aae554484f01 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050945 Jul 04 08:11:34.964892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 568/1062] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:11:35.744729 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-53f2b00f-448f-42fb-b150-5f312a4e6774 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:35.745448 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-53f2b00f-448f-42fb-b150-5f312a4e6774 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:35.754432 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-53f2b00f-448f-42fb-b150-5f312a4e6774 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:35.754874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-53f2b00f-448f-42fb-b150-5f312a4e6774 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:35.755670 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-53f2b00f-448f-42fb-b150-5f312a4e6774 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:35.756099 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-53f2b00f-448f-42fb-b150-5f312a4e6774 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:35.903364 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-53f2b00f-448f-42fb-b150-5f312a4e6774 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:35.911399 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-53f2b00f-448f-42fb-b150-5f312a4e6774 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1313 microversion: 2.1 time: 0.170704 Jul 04 08:11:35.912214 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 495/1063] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:35 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:36.931087 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9af7684e-d026-4ca7-85c2-4db5818ec850 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:36.931783 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9af7684e-d026-4ca7-85c2-4db5818ec850 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:36.938563 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9af7684e-d026-4ca7-85c2-4db5818ec850 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:36.938996 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9af7684e-d026-4ca7-85c2-4db5818ec850 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:36.939761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9af7684e-d026-4ca7-85c2-4db5818ec850 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:36.940213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9af7684e-d026-4ca7-85c2-4db5818ec850 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:37.097192 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9af7684e-d026-4ca7-85c2-4db5818ec850 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:37.106533 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9af7684e-d026-4ca7-85c2-4db5818ec850 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1497 microversion: 2.1 time: 0.180299 Jul 04 08:11:37.107115 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 569/1064] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:36 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:37.713592 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6e9c8c42-cea2-4708-8874-2d85e7b96a00 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:37.714155 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6e9c8c42-cea2-4708-8874-2d85e7b96a00 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:37.720805 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c42-cea2-4708-8874-2d85e7b96a00 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:37.721250 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c42-cea2-4708-8874-2d85e7b96a00 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:37.722041 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c42-cea2-4708-8874-2d85e7b96a00 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:37.722470 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6e9c8c42-cea2-4708-8874-2d85e7b96a00 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:37.748870 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6e9c8c42-cea2-4708-8874-2d85e7b96a00 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:11:37.854854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6e9c8c42-cea2-4708-8874-2d85e7b96a00 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 204 len: 0 microversion: 2.1 time: 0.143914 Jul 04 08:11:37.855874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 496/1065] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:11:37 2022] DELETE /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:11:37.865932 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6ba55318-1c8b-4c48-8d7b-298f38b38719 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:37.866579 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6ba55318-1c8b-4c48-8d7b-298f38b38719 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:37.873165 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ba55318-1c8b-4c48-8d7b-298f38b38719 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:37.873476 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ba55318-1c8b-4c48-8d7b-298f38b38719 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:37.874251 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ba55318-1c8b-4c48-8d7b-298f38b38719 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:37.874755 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ba55318-1c8b-4c48-8d7b-298f38b38719 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:38.037857 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6ba55318-1c8b-4c48-8d7b-298f38b38719 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:38.047728 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6ba55318-1c8b-4c48-8d7b-298f38b38719 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1503 microversion: 2.1 time: 0.186586 Jul 04 08:11:38.048442 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 570/1066] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:37 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:11:39.068229 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-774e8f5e-e566-470a-91f3-55f202bb93a5 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:39.070624 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-774e8f5e-e566-470a-91f3-55f202bb93a5 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:39.081234 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-774e8f5e-e566-470a-91f3-55f202bb93a5 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:39.081852 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-774e8f5e-e566-470a-91f3-55f202bb93a5 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:39.082927 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-774e8f5e-e566-470a-91f3-55f202bb93a5 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:39.083504 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-774e8f5e-e566-470a-91f3-55f202bb93a5 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:39.266432 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-774e8f5e-e566-470a-91f3-55f202bb93a5 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:39.278518 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-774e8f5e-e566-470a-91f3-55f202bb93a5 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1503 microversion: 2.1 time: 0.215358 Jul 04 08:11:39.290105 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 497/1067] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:39 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:40.034721 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-c767ce82-e6df-42c2-bd4c-a9c3be80c30c req-090a3bda-82b1-44d7-b42d-ac3ade684160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85ecef4-02fa-4c4b-a172-172f3836b010", "name": "network-vif-deleted", "tag": "105ec75a-d71c-415e-b0bc-e1e5b3cef180"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:40.055625 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-c767ce82-e6df-42c2-bd4c-a9c3be80c30c req-090a3bda-82b1-44d7-b42d-ac3ade684160 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:40.056619 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-c767ce82-e6df-42c2-bd4c-a9c3be80c30c req-090a3bda-82b1-44d7-b42d-ac3ade684160 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:40.071970 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-c767ce82-e6df-42c2-bd4c-a9c3be80c30c req-090a3bda-82b1-44d7-b42d-ac3ade684160 service nova] Creating event network-vif-deleted:105ec75a-d71c-415e-b0bc-e1e5b3cef180 for instance c85ecef4-02fa-4c4b-a172-172f3836b010 on hv-cinder-79760 Jul 04 08:11:40.078697 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-c767ce82-e6df-42c2-bd4c-a9c3be80c30c req-090a3bda-82b1-44d7-b42d-ac3ade684160 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050686 Jul 04 08:11:40.079797 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 571/1068] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:40.301165 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-5a665eee-b6c0-4186-aeb1-6fefb189b695 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:40.303362 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-5a665eee-b6c0-4186-aeb1-6fefb189b695 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:40.314657 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5a665eee-b6c0-4186-aeb1-6fefb189b695 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:40.315723 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5a665eee-b6c0-4186-aeb1-6fefb189b695 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:40.317344 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5a665eee-b6c0-4186-aeb1-6fefb189b695 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:40.318140 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-5a665eee-b6c0-4186-aeb1-6fefb189b695 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:40.408743 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-5a665eee-b6c0-4186-aeb1-6fefb189b695 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:40.420424 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-5a665eee-b6c0-4186-aeb1-6fefb189b695 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1461 microversion: 2.1 time: 0.126769 Jul 04 08:11:40.430774 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 498/1069] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:40 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1461 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:41.440355 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e11cd55d-9235-47a9-8910-8e0535f961fb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:41.440737 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e11cd55d-9235-47a9-8910-8e0535f961fb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:41.447287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e11cd55d-9235-47a9-8910-8e0535f961fb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:41.447800 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e11cd55d-9235-47a9-8910-8e0535f961fb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:41.448585 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e11cd55d-9235-47a9-8910-8e0535f961fb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:41.449019 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e11cd55d-9235-47a9-8910-8e0535f961fb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:41.534845 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e11cd55d-9235-47a9-8910-8e0535f961fb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:41.544747 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e11cd55d-9235-47a9-8910-8e0535f961fb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1461 microversion: 2.1 time: 0.109795 Jul 04 08:11:41.545836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 572/1070] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:41 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1461 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:42.563780 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:42.564611 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:42.576692 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:42.577474 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:42.579590 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:42.580603 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:42.638901 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:42.639533 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:42.640297 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lazy-loading 'fault' on Instance uuid c85ecef4-02fa-4c4b-a172-172f3836b010 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:11:42.693405 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:42.703812 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-836f4999-a22d-479e-97c8-f95a023cfa57 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1303 microversion: 2.1 time: 0.144676 Jul 04 08:11:42.705227 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 499/1071] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:42 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1303 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:43.726223 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:43.727289 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:43.735246 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:43.735694 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:43.736457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:43.736901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:43.784510 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:43.785048 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:43.785499 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lazy-loading 'fault' on Instance uuid c85ecef4-02fa-4c4b-a172-172f3836b010 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:11:43.847298 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:43.858936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-04676f3d-d22f-4dcd-9861-e108b74e9741 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1303 microversion: 2.1 time: 0.140140 Jul 04 08:11:43.867418 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 573/1072] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:43 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1303 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:44.882304 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:44.883947 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:44.893094 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:44.893528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:44.894335 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:44.894778 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:44.931907 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:44.932349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:44.932850 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lazy-loading 'fault' on Instance uuid c85ecef4-02fa-4c4b-a172-172f3836b010 {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:11:44.982561 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:44.991951 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-54e622a9-5523-4819-b52e-c3ecfc5882e4 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 200 len: 1303 microversion: 2.1 time: 0.115130 Jul 04 08:11:44.992620 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 500/1073] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:44 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:46.016668 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:46.020803 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: c85ecef4-02fa-4c4b-a172-172f3836b010] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:46.034639 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:46.035396 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:46.036846 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:46.037604 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:46.060817 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] HTTP exception thrown: Instance c85ecef4-02fa-4c4b-a172-172f3836b010 could not be found. Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Request method failure captured: Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 HTTP/1.1 Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwqCoBmKPJ9OADLMucknfigI45VQDAL4qOj6QnYlTG2Ic8xljoWz88hnEHcxsflYlKEUOHhPBY1eiwouHq78YVtkRCrEcuOLcOBElGwP8ZeKuf9mh-k0u14KQJiySwA7Onboxcxte8eeUBCK6e3LsNrh6EGRokIduA_XjkahcNrqm4DM Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: bfb2bf1afead415b9d6ee79ad836197d Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesActionsTest-1893288421 Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:11:46.062943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bfb2bf1afead415b9d6ee79ad836197d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bfb2bf1afead415b9d6ee79ad836197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bfb2bf1afead415b9d6ee79ad836197d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bfb2bf1afead415b9d6ee79ad836197d", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesActionsTest-1893288421 Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: bfb2bf1afead415b9d6ee79ad836197d Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesActionsTest-1893288421 Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesActionsTest-1893288421-project Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 0224639fe5d24820bdead1bba468ddda Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesActionsTest-1893288421-project Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance c85ecef4-02fa-4c4b-a172-172f3836b010 could not be found. Jul 04 08:11:46.067445 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': 'c85ecef4-02fa-4c4b-a172-172f3836b010'} Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c85ecef4-02fa-4c4b-a172-172f3836b010 could not be found. Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:11:46.068696 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c85ecef4-02fa-4c4b-a172-172f3836b010 could not be found. Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c85ecef4-02fa-4c4b-a172-172f3836b010 could not be found. Jul 04 08:11:46.070439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:11:46.071846 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Returning 404 to user: Instance c85ecef4-02fa-4c4b-a172-172f3836b010 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:11:46.071846 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f8ea93c1-acd1-4bb6-9733-49b4bf25e7bb tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010" status: 404 len: 111 microversion: 2.1 time: 0.056039 Jul 04 08:11:46.071846 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 574/1074] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:46 2022] GET /compute/v2.1/servers/c85ecef4-02fa-4c4b-a172-172f3836b010 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:11:46.195171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-481204402", "imageRef": "f5dbde99-7208-403a-ac0a-ecfcfcafd080", "flavorRef": "452", "networks": [{"uuid": "6e7898bc-de9c-493f-9736-0a99ce014a8c"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:46.260244 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] validate_networks() for [('6e7898bc-de9c-493f-9736-0a99ce014a8c', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:11:46.691091 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:11:46.691512 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:11:46.696647 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:11:46.696647 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:11:46.696647 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:11:46.703050 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:46.703519 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:46.704329 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:46.704758 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:46.723214 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Getting quotas for project bfb2bf1afead415b9d6ee79ad836197d. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:11:46.728908 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Getting quotas for user 0224639fe5d24820bdead1bba468ddda and project bfb2bf1afead415b9d6ee79ad836197d. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:11:46.741968 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:11:46.744338 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f5dbde99-7208-403a-ac0a-ecfcfcafd080',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:11:46.798591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-004debe4-befe-4a43-aaea-e47ed8615467 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607058 Jul 04 08:11:46.799388 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 501/1075] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:11:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:11:46.810466 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ca97800d-c713-457a-9a2c-ff8aeda59a43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:46.811492 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ca97800d-c713-457a-9a2c-ff8aeda59a43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:46.889469 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ca97800d-c713-457a-9a2c-ff8aeda59a43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:46.900761 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ca97800d-c713-457a-9a2c-ff8aeda59a43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1213 microversion: 2.1 time: 0.094090 Jul 04 08:11:46.901747 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 575/1076] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:46 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1213 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:47.923288 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-c8a1121d-79b2-49fe-8ba5-9e864cf1af2d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:47.923898 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-c8a1121d-79b2-49fe-8ba5-9e864cf1af2d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:47.930558 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8a1121d-79b2-49fe-8ba5-9e864cf1af2d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:47.931046 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8a1121d-79b2-49fe-8ba5-9e864cf1af2d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:47.931824 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8a1121d-79b2-49fe-8ba5-9e864cf1af2d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:47.932252 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-c8a1121d-79b2-49fe-8ba5-9e864cf1af2d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:48.007586 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-c8a1121d-79b2-49fe-8ba5-9e864cf1af2d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:48.018064 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-c8a1121d-79b2-49fe-8ba5-9e864cf1af2d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1217 microversion: 2.1 time: 0.099266 Jul 04 08:11:48.018696 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 502/1077] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:47 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1217 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:49.036837 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-298cae74-e487-46c8-84a8-2a6a85c2426b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:49.037683 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-298cae74-e487-46c8-84a8-2a6a85c2426b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:49.046612 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-298cae74-e487-46c8-84a8-2a6a85c2426b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:49.047067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-298cae74-e487-46c8-84a8-2a6a85c2426b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:49.047897 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-298cae74-e487-46c8-84a8-2a6a85c2426b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:49.048335 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-298cae74-e487-46c8-84a8-2a6a85c2426b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:49.130774 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-298cae74-e487-46c8-84a8-2a6a85c2426b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:49.139194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-298cae74-e487-46c8-84a8-2a6a85c2426b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1265 microversion: 2.1 time: 0.106323 Jul 04 08:11:49.139913 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 576/1078] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:49 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1265 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:50.161896 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-be56a0b0-4c71-4dd0-bf43-f58440c86d3b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:50.162539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-be56a0b0-4c71-4dd0-bf43-f58440c86d3b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:50.166100 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:50.181360 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be56a0b0-4c71-4dd0-bf43-f58440c86d3b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:50.181360 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be56a0b0-4c71-4dd0-bf43-f58440c86d3b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:50.181360 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be56a0b0-4c71-4dd0-bf43-f58440c86d3b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:50.181360 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-be56a0b0-4c71-4dd0-bf43-f58440c86d3b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:50.182450 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:50.441461 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-be56a0b0-4c71-4dd0-bf43-f58440c86d3b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:50.449704 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-be56a0b0-4c71-4dd0-bf43-f58440c86d3b tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.294994 Jul 04 08:11:50.450490 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 503/1079] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:50 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:51.045042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-b221828c-47b6-452e-b68b-25c0eb20dd0f req-1ac4dc38-c65b-4563-9527-c64320a1c3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "771716ec-2377-407f-b6b9-ed2259350710", "tag": "88ee4c7e-f9df-4bb2-a375-a5c184faebbf"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:11:51.053510 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:51.055774 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-b221828c-47b6-452e-b68b-25c0eb20dd0f req-1ac4dc38-c65b-4563-9527-c64320a1c3b0 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:51.056343 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-b221828c-47b6-452e-b68b-25c0eb20dd0f req-1ac4dc38-c65b-4563-9527-c64320a1c3b0 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:51.069916 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=71 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:51.073749 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-b221828c-47b6-452e-b68b-25c0eb20dd0f req-1ac4dc38-c65b-4563-9527-c64320a1c3b0 service nova] Creating event network-changed:88ee4c7e-f9df-4bb2-a375-a5c184faebbf for instance 771716ec-2377-407f-b6b9-ed2259350710 on hv-cinder-79760 Jul 04 08:11:51.079976 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-b221828c-47b6-452e-b68b-25c0eb20dd0f req-1ac4dc38-c65b-4563-9527-c64320a1c3b0 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039234 Jul 04 08:11:51.080862 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 577/1080] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:11:51.468082 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-81872de2-98ed-4cbe-8244-a689e94a52f9 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:51.468681 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-81872de2-98ed-4cbe-8244-a689e94a52f9 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:51.476042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81872de2-98ed-4cbe-8244-a689e94a52f9 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:51.476961 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81872de2-98ed-4cbe-8244-a689e94a52f9 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:51.477892 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81872de2-98ed-4cbe-8244-a689e94a52f9 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:51.478359 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-81872de2-98ed-4cbe-8244-a689e94a52f9 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:51.707845 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-81872de2-98ed-4cbe-8244-a689e94a52f9 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:51.721104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-81872de2-98ed-4cbe-8244-a689e94a52f9 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.256875 Jul 04 08:11:51.722193 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 504/1081] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:51 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:52.743142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c8803a27-47e7-4ca8-9faa-17d764fa2341 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:52.743997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c8803a27-47e7-4ca8-9faa-17d764fa2341 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:52.752008 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c8803a27-47e7-4ca8-9faa-17d764fa2341 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:52.753294 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c8803a27-47e7-4ca8-9faa-17d764fa2341 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:52.754470 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c8803a27-47e7-4ca8-9faa-17d764fa2341 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:52.755154 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c8803a27-47e7-4ca8-9faa-17d764fa2341 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:52.917231 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c8803a27-47e7-4ca8-9faa-17d764fa2341 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:52.925400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c8803a27-47e7-4ca8-9faa-17d764fa2341 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.187919 Jul 04 08:11:52.925954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 578/1082] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:52 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:53.943422 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a72ca25a-70c2-4af1-ac44-d9fcd8faf9b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:53.945279 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a72ca25a-70c2-4af1-ac44-d9fcd8faf9b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:53.953996 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a72ca25a-70c2-4af1-ac44-d9fcd8faf9b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:53.955022 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a72ca25a-70c2-4af1-ac44-d9fcd8faf9b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:53.956074 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a72ca25a-70c2-4af1-ac44-d9fcd8faf9b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:53.956721 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a72ca25a-70c2-4af1-ac44-d9fcd8faf9b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:54.117057 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a72ca25a-70c2-4af1-ac44-d9fcd8faf9b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:54.126897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a72ca25a-70c2-4af1-ac44-d9fcd8faf9b7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.188374 Jul 04 08:11:54.127523 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 505/1083] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:53 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:55.144714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d9dc5e33-f5a0-4024-8d0f-b9ddcaf7084d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:55.146037 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d9dc5e33-f5a0-4024-8d0f-b9ddcaf7084d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:55.153849 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9dc5e33-f5a0-4024-8d0f-b9ddcaf7084d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:55.154288 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9dc5e33-f5a0-4024-8d0f-b9ddcaf7084d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:55.155501 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9dc5e33-f5a0-4024-8d0f-b9ddcaf7084d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:55.155656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9dc5e33-f5a0-4024-8d0f-b9ddcaf7084d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:55.317190 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d9dc5e33-f5a0-4024-8d0f-b9ddcaf7084d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:55.328815 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d9dc5e33-f5a0-4024-8d0f-b9ddcaf7084d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.187867 Jul 04 08:11:55.329549 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 579/1084] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:55 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:56.350213 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0aae4bef-b333-4009-901a-5f9773e769fd tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:56.350935 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0aae4bef-b333-4009-901a-5f9773e769fd tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:56.359507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0aae4bef-b333-4009-901a-5f9773e769fd tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:56.359975 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0aae4bef-b333-4009-901a-5f9773e769fd tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:56.360736 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0aae4bef-b333-4009-901a-5f9773e769fd tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:56.361366 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0aae4bef-b333-4009-901a-5f9773e769fd tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:56.514104 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0aae4bef-b333-4009-901a-5f9773e769fd tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:56.523070 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0aae4bef-b333-4009-901a-5f9773e769fd tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.176727 Jul 04 08:11:56.523598 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 506/1085] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:56 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:57.540369 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a453da28-42ad-458a-b8a7-a8afb6e2bd44 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:57.541044 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a453da28-42ad-458a-b8a7-a8afb6e2bd44 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:57.543630 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:57.550084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a453da28-42ad-458a-b8a7-a8afb6e2bd44 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:57.550403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a453da28-42ad-458a-b8a7-a8afb6e2bd44 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:57.550999 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a453da28-42ad-458a-b8a7-a8afb6e2bd44 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:57.551411 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a453da28-42ad-458a-b8a7-a8afb6e2bd44 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:57.709685 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a453da28-42ad-458a-b8a7-a8afb6e2bd44 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:57.718582 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a453da28-42ad-458a-b8a7-a8afb6e2bd44 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.181540 Jul 04 08:11:57.719385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 580/1086] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:57 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:11:58.738704 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-223d0c9c-05d2-4d00-a89c-b32e747dc21d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:58.739442 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-223d0c9c-05d2-4d00-a89c-b32e747dc21d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:58.742581 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:58.743774 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:11:58.752642 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-223d0c9c-05d2-4d00-a89c-b32e747dc21d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:58.753605 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-223d0c9c-05d2-4d00-a89c-b32e747dc21d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:58.754478 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-223d0c9c-05d2-4d00-a89c-b32e747dc21d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:58.754962 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-223d0c9c-05d2-4d00-a89c-b32e747dc21d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:58.918536 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-223d0c9c-05d2-4d00-a89c-b32e747dc21d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:11:58.927035 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-223d0c9c-05d2-4d00-a89c-b32e747dc21d tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.194444 Jul 04 08:11:58.927877 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 507/1087] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:58 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:11:59.947094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-90fc7539-b0d5-4632-8e56-3bdbb9382162 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:11:59.948052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-90fc7539-b0d5-4632-8e56-3bdbb9382162 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:11:59.954978 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-90fc7539-b0d5-4632-8e56-3bdbb9382162 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:59.955431 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-90fc7539-b0d5-4632-8e56-3bdbb9382162 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:11:59.956181 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-90fc7539-b0d5-4632-8e56-3bdbb9382162 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:11:59.956600 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-90fc7539-b0d5-4632-8e56-3bdbb9382162 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:00.090293 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-90fc7539-b0d5-4632-8e56-3bdbb9382162 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:00.098996 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-90fc7539-b0d5-4632-8e56-3bdbb9382162 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.155753 Jul 04 08:12:00.099592 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 581/1088] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:11:59 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:00.829971 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-7d5d856e-8754-40f8-aab1-8a3129472f11 req-0eb7d5cb-6d49-4f21-8b43-d49a14729128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771716ec-2377-407f-b6b9-ed2259350710", "name": "network-vif-plugged", "status": "completed", "tag": "88ee4c7e-f9df-4bb2-a375-a5c184faebbf"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:12:00.838854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7d5d856e-8754-40f8-aab1-8a3129472f11 req-0eb7d5cb-6d49-4f21-8b43-d49a14729128 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:00.839262 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-7d5d856e-8754-40f8-aab1-8a3129472f11 req-0eb7d5cb-6d49-4f21-8b43-d49a14729128 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:00.851183 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-7d5d856e-8754-40f8-aab1-8a3129472f11 req-0eb7d5cb-6d49-4f21-8b43-d49a14729128 service nova] Creating event network-vif-plugged:88ee4c7e-f9df-4bb2-a375-a5c184faebbf for instance 771716ec-2377-407f-b6b9-ed2259350710 on hv-cinder-79760 Jul 04 08:12:00.856426 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-7d5d856e-8754-40f8-aab1-8a3129472f11 req-0eb7d5cb-6d49-4f21-8b43-d49a14729128 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030385 Jul 04 08:12:00.857049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 508/1089] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:12:01.122889 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-db464ef1-efce-43ed-8b1c-c4e54299f8ff tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:01.123509 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-db464ef1-efce-43ed-8b1c-c4e54299f8ff tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:01.136906 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db464ef1-efce-43ed-8b1c-c4e54299f8ff tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:01.137943 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db464ef1-efce-43ed-8b1c-c4e54299f8ff tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:01.138944 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db464ef1-efce-43ed-8b1c-c4e54299f8ff tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:01.140356 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db464ef1-efce-43ed-8b1c-c4e54299f8ff tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:01.285414 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-db464ef1-efce-43ed-8b1c-c4e54299f8ff tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:01.293486 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-db464ef1-efce-43ed-8b1c-c4e54299f8ff tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.178382 Jul 04 08:12:01.294194 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 582/1090] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:01 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:02.316090 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ec7a78a8-7f07-4b96-bddd-c7ec3502d191 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:02.316907 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ec7a78a8-7f07-4b96-bddd-c7ec3502d191 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:02.326078 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec7a78a8-7f07-4b96-bddd-c7ec3502d191 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:02.326078 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec7a78a8-7f07-4b96-bddd-c7ec3502d191 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:02.326078 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec7a78a8-7f07-4b96-bddd-c7ec3502d191 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:02.326078 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ec7a78a8-7f07-4b96-bddd-c7ec3502d191 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:02.576854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-ec7a78a8-7f07-4b96-bddd-c7ec3502d191 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:02.585296 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ec7a78a8-7f07-4b96-bddd-c7ec3502d191 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.277952 Jul 04 08:12:02.595739 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 509/1091] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:02 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:03.603925 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-103c47cd-708d-4f45-a4eb-72d4c65142e6 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:03.604639 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-103c47cd-708d-4f45-a4eb-72d4c65142e6 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:03.613575 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-103c47cd-708d-4f45-a4eb-72d4c65142e6 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:03.614323 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-103c47cd-708d-4f45-a4eb-72d4c65142e6 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:03.615321 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-103c47cd-708d-4f45-a4eb-72d4c65142e6 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:03.615860 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-103c47cd-708d-4f45-a4eb-72d4c65142e6 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:03.768006 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-103c47cd-708d-4f45-a4eb-72d4c65142e6 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:03.776744 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-103c47cd-708d-4f45-a4eb-72d4c65142e6 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.176759 Jul 04 08:12:03.777591 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 583/1092] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:03 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:03.797805 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f8a4aaaf-381f-493b-a0a1-c488419a43ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:03.798331 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f8a4aaaf-381f-493b-a0a1-c488419a43ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:03.805891 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8a4aaaf-381f-493b-a0a1-c488419a43ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:03.806722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-0467d37c-e975-4c5e-9db9-d5f19fb51cb6 req-dd5a6cca-6371-4d1c-9127-d900a2530d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bf7886-bd99-4926-bb03-78d6488963f8", "tag": "7b293845-76c3-49eb-ad43-17b180aeee72"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:12:03.806979 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8a4aaaf-381f-493b-a0a1-c488419a43ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:03.807990 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8a4aaaf-381f-493b-a0a1-c488419a43ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:03.809659 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f8a4aaaf-381f-493b-a0a1-c488419a43ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:03.815460 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-0467d37c-e975-4c5e-9db9-d5f19fb51cb6 req-dd5a6cca-6371-4d1c-9127-d900a2530d7a service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:03.815998 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-0467d37c-e975-4c5e-9db9-d5f19fb51cb6 req-dd5a6cca-6371-4d1c-9127-d900a2530d7a service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:03.828463 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-0467d37c-e975-4c5e-9db9-d5f19fb51cb6 req-dd5a6cca-6371-4d1c-9127-d900a2530d7a service nova] Creating event network-changed:7b293845-76c3-49eb-ad43-17b180aeee72 for instance 52bf7886-bd99-4926-bb03-78d6488963f8 on hv-cinder-79760 Jul 04 08:12:03.834123 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-0467d37c-e975-4c5e-9db9-d5f19fb51cb6 req-dd5a6cca-6371-4d1c-9127-d900a2530d7a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030836 Jul 04 08:12:03.835052 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 584/1093] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:12:03.849174 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f8a4aaaf-381f-493b-a0a1-c488419a43ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:12:03.944730 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f8a4aaaf-381f-493b-a0a1-c488419a43ac tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "DELETE /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 204 len: 0 microversion: 2.1 time: 0.150816 Jul 04 08:12:03.946290 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 510/1094] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:12:03 2022] DELETE /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:12:03.957344 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-369745d1-7f8d-4c10-bd1e-56e4edb1d2d2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:03.958305 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-369745d1-7f8d-4c10-bd1e-56e4edb1d2d2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:03.966560 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-369745d1-7f8d-4c10-bd1e-56e4edb1d2d2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:03.967189 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-369745d1-7f8d-4c10-bd1e-56e4edb1d2d2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:03.968382 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-369745d1-7f8d-4c10-bd1e-56e4edb1d2d2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:03.969083 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-369745d1-7f8d-4c10-bd1e-56e4edb1d2d2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:04.130670 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-369745d1-7f8d-4c10-bd1e-56e4edb1d2d2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:04.150291 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-369745d1-7f8d-4c10-bd1e-56e4edb1d2d2 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.196611 Jul 04 08:12:04.154439 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 585/1095] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:03 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:04.795567 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4ebef111-1531-4d17-950c-c4f2e09c734f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:04.796674 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4ebef111-1531-4d17-950c-c4f2e09c734f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:04.805155 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ebef111-1531-4d17-950c-c4f2e09c734f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:04.805768 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ebef111-1531-4d17-950c-c4f2e09c734f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:04.806409 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ebef111-1531-4d17-950c-c4f2e09c734f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:04.806928 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4ebef111-1531-4d17-950c-c4f2e09c734f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:04.959636 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4ebef111-1531-4d17-950c-c4f2e09c734f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:04.968414 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4ebef111-1531-4d17-950c-c4f2e09c734f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.177269 Jul 04 08:12:04.969006 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 511/1096] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:04 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:05.165109 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9f39eccf-f8cb-4997-a0ee-9606d75e7f96 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:05.165814 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9f39eccf-f8cb-4997-a0ee-9606d75e7f96 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:05.172816 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f39eccf-f8cb-4997-a0ee-9606d75e7f96 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:05.173256 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f39eccf-f8cb-4997-a0ee-9606d75e7f96 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:05.174073 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f39eccf-f8cb-4997-a0ee-9606d75e7f96 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:05.174562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9f39eccf-f8cb-4997-a0ee-9606d75e7f96 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:05.326069 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9f39eccf-f8cb-4997-a0ee-9606d75e7f96 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:05.336995 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9f39eccf-f8cb-4997-a0ee-9606d75e7f96 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.175523 Jul 04 08:12:05.337827 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 586/1097] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:05 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:05.988108 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f69804eb-84bc-4e2a-9bda-e8918e7390b8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:05.988755 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f69804eb-84bc-4e2a-9bda-e8918e7390b8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:05.996443 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f69804eb-84bc-4e2a-9bda-e8918e7390b8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:05.997093 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f69804eb-84bc-4e2a-9bda-e8918e7390b8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:05.998604 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f69804eb-84bc-4e2a-9bda-e8918e7390b8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:05.999980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f69804eb-84bc-4e2a-9bda-e8918e7390b8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:06.148787 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f69804eb-84bc-4e2a-9bda-e8918e7390b8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:06.157608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f69804eb-84bc-4e2a-9bda-e8918e7390b8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1313 microversion: 2.1 time: 0.175169 Jul 04 08:12:06.167185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 512/1098] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:05 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:06.355422 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f8306128-fb54-4a36-96e4-e88837d2b91c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:06.356788 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f8306128-fb54-4a36-96e4-e88837d2b91c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:06.363795 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8306128-fb54-4a36-96e4-e88837d2b91c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:06.364914 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8306128-fb54-4a36-96e4-e88837d2b91c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:06.365827 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8306128-fb54-4a36-96e4-e88837d2b91c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:06.366332 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8306128-fb54-4a36-96e4-e88837d2b91c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:06.512429 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f8306128-fb54-4a36-96e4-e88837d2b91c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:06.522133 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f8306128-fb54-4a36-96e4-e88837d2b91c tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1568 microversion: 2.1 time: 0.170293 Jul 04 08:12:06.523120 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 587/1099] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:06 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:07.176224 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f27f508e-b1f6-4c04-9626-e9b23b08005f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:07.176986 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f27f508e-b1f6-4c04-9626-e9b23b08005f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:07.185470 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f27f508e-b1f6-4c04-9626-e9b23b08005f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:07.185951 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f27f508e-b1f6-4c04-9626-e9b23b08005f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:07.186931 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f27f508e-b1f6-4c04-9626-e9b23b08005f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:07.187374 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f27f508e-b1f6-4c04-9626-e9b23b08005f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:07.400063 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f27f508e-b1f6-4c04-9626-e9b23b08005f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:07.409925 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f27f508e-b1f6-4c04-9626-e9b23b08005f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1497 microversion: 2.1 time: 0.238416 Jul 04 08:12:07.410817 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 513/1100] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:07 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1497 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:07.542039 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-da0a145d-d585-486c-8d0b-c19b65e34474 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:07.544290 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-da0a145d-d585-486c-8d0b-c19b65e34474 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:07.558660 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da0a145d-d585-486c-8d0b-c19b65e34474 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:07.559414 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da0a145d-d585-486c-8d0b-c19b65e34474 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:07.560849 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da0a145d-d585-486c-8d0b-c19b65e34474 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:07.562533 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da0a145d-d585-486c-8d0b-c19b65e34474 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:07.577518 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-5dfbf361-e39a-4692-9c84-ca11370ccfa0 req-4a9b83c7-936f-4589-b9e9-4234f980c974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bf7886-bd99-4926-bb03-78d6488963f8", "name": "network-vif-deleted", "tag": "7b293845-76c3-49eb-ad43-17b180aeee72"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:12:07.590597 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-5dfbf361-e39a-4692-9c84-ca11370ccfa0 req-4a9b83c7-936f-4589-b9e9-4234f980c974 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:07.590597 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-5dfbf361-e39a-4692-9c84-ca11370ccfa0 req-4a9b83c7-936f-4589-b9e9-4234f980c974 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:07.600942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-5dfbf361-e39a-4692-9c84-ca11370ccfa0 req-4a9b83c7-936f-4589-b9e9-4234f980c974 service nova] Creating event network-vif-deleted:7b293845-76c3-49eb-ad43-17b180aeee72 for instance 52bf7886-bd99-4926-bb03-78d6488963f8 on hv-cinder-79760 Jul 04 08:12:07.606280 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-5dfbf361-e39a-4692-9c84-ca11370ccfa0 req-4a9b83c7-936f-4589-b9e9-4234f980c974 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034523 Jul 04 08:12:07.607283 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 514/1101] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:12:07.689794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da0a145d-d585-486c-8d0b-c19b65e34474 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a860176540c64e6db269f9ebe4d75753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2609f0b160e0450798be03f7d3e993ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:07.709072 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-da0a145d-d585-486c-8d0b-c19b65e34474 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 200 len: 1382 microversion: 2.1 time: 0.172467 Jul 04 08:12:07.709801 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 588/1102] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:07 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 1382 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:08.498768 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e78135ba-b10d-4888-8f69-f3af3e8f3ad8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:08.499444 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e78135ba-b10d-4888-8f69-f3af3e8f3ad8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:08.506378 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e78135ba-b10d-4888-8f69-f3af3e8f3ad8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:08.506824 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e78135ba-b10d-4888-8f69-f3af3e8f3ad8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:08.507602 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e78135ba-b10d-4888-8f69-f3af3e8f3ad8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:08.508024 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e78135ba-b10d-4888-8f69-f3af3e8f3ad8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:08.534318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e78135ba-b10d-4888-8f69-f3af3e8f3ad8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:12:08.626335 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e78135ba-b10d-4888-8f69-f3af3e8f3ad8 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "DELETE /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 204 len: 0 microversion: 2.1 time: 0.132176 Jul 04 08:12:08.627481 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 515/1103] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:12:08 2022] DELETE /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:12:08.636121 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6168f5d1-58d8-433a-88e6-16b017f981d0 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:08.636760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6168f5d1-58d8-433a-88e6-16b017f981d0 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:08.643947 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6168f5d1-58d8-433a-88e6-16b017f981d0 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:08.644726 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6168f5d1-58d8-433a-88e6-16b017f981d0 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:08.645498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6168f5d1-58d8-433a-88e6-16b017f981d0 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:08.645959 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6168f5d1-58d8-433a-88e6-16b017f981d0 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:08.728077 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:08.728809 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] [instance: 52bf7886-bd99-4926-bb03-78d6488963f8] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:08.735897 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:08.736348 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:08.737542 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:08.737999 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:08.752329 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] HTTP exception thrown: Instance 52bf7886-bd99-4926-bb03-78d6488963f8 could not be found. Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Request method failure captured: Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 HTTP/1.1 Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp90mGntxXZjfR5A_FVft4FGEY3GcFQT4en2k1iGyoTF2lOGtpBIdM3sV6fPPPqDznPj0WiGoUATu0g7Vv6fYpjFD3yHazNvHAOzG4yZre3HIGDu8LqQt9chKfnf5ecoqjjlxUXfVwHV3p6StFItgi0C682h1yGsMKbu_LBWlLiXabc Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: 2609f0b160e0450798be03f7d3e993ad Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-TestShelveInstance-572820629 Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:12:08.754619 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2609f0b160e0450798be03f7d3e993ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/2609f0b160e0450798be03f7d3e993ad"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/2609f0b160e0450798be03f7d3e993ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_2609f0b160e0450798be03f7d3e993ad", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-TestShelveInstance-572820629 Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: 2609f0b160e0450798be03f7d3e993ad Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-TestShelveInstance-572820629 Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-TestShelveInstance-572820629-project Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: a860176540c64e6db269f9ebe4d75753 Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-TestShelveInstance-572820629-project Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 52bf7886-bd99-4926-bb03-78d6488963f8 could not be found. Jul 04 08:12:08.756179 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '52bf7886-bd99-4926-bb03-78d6488963f8'} Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52bf7886-bd99-4926-bb03-78d6488963f8 could not be found. Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:12:08.757052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52bf7886-bd99-4926-bb03-78d6488963f8 could not be found. Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52bf7886-bd99-4926-bb03-78d6488963f8 could not be found. Jul 04 08:12:08.758384 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:12:08.759569 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Returning 404 to user: Instance 52bf7886-bd99-4926-bb03-78d6488963f8 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:12:08.759569 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-e9917fbc-a7a3-45a3-96ec-d887a645b5ce tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8" status: 404 len: 111 microversion: 2.1 time: 0.032431 Jul 04 08:12:08.759569 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 516/1104] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:08 2022] GET /compute/v2.1/servers/52bf7886-bd99-4926-bb03-78d6488963f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 08:12:08.796448 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6168f5d1-58d8-433a-88e6-16b017f981d0 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:08.804425 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6168f5d1-58d8-433a-88e6-16b017f981d0 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1503 microversion: 2.1 time: 0.172349 Jul 04 08:12:08.805007 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 589/1105] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:08 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:08.937204 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0cd6a7b9-ee9e-4ef3-bae2-bb2fba150d81 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] Calling method '.version_select at 0x7f05e56fc0d0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:08.959596 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0cd6a7b9-ee9e-4ef3-bae2-bb2fba150d81 tempest-TestShelveInstance-572820629 tempest-TestShelveInstance-572820629-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1224536609" status: 202 len: 0 microversion: 2.1 time: 0.026298 Jul 04 08:12:08.960402 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 517/1106] 10.222.0.43 () {58 vars in 1253 bytes} [Mon Jul 4 08:12:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1224536609 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:12:09.825254 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0c0f67dc-786f-41c0-8dcf-a2f9fabac0ee tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:09.826042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0c0f67dc-786f-41c0-8dcf-a2f9fabac0ee tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:09.834885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c0f67dc-786f-41c0-8dcf-a2f9fabac0ee tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:09.835360 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c0f67dc-786f-41c0-8dcf-a2f9fabac0ee tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:09.836121 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c0f67dc-786f-41c0-8dcf-a2f9fabac0ee tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:09.836598 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c0f67dc-786f-41c0-8dcf-a2f9fabac0ee tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:10.045930 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0c0f67dc-786f-41c0-8dcf-a2f9fabac0ee tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:10.054337 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0c0f67dc-786f-41c0-8dcf-a2f9fabac0ee tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1503 microversion: 2.1 time: 0.233218 Jul 04 08:12:10.054950 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 590/1107] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:09 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:11.072598 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d0d57b87-2f5f-415b-b6d5-6e2afa005f43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:11.073689 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d0d57b87-2f5f-415b-b6d5-6e2afa005f43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:11.081784 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0d57b87-2f5f-415b-b6d5-6e2afa005f43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:11.082202 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0d57b87-2f5f-415b-b6d5-6e2afa005f43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:11.082967 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0d57b87-2f5f-415b-b6d5-6e2afa005f43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:11.083434 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d0d57b87-2f5f-415b-b6d5-6e2afa005f43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:11.270149 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-d0d57b87-2f5f-415b-b6d5-6e2afa005f43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:11.278963 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d0d57b87-2f5f-415b-b6d5-6e2afa005f43 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1503 microversion: 2.1 time: 0.211101 Jul 04 08:12:11.280185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 518/1108] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:11 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:12.299198 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-936a3e4f-86fd-4ff4-bedd-702fd4cb9b56 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:12.300553 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-936a3e4f-86fd-4ff4-bedd-702fd4cb9b56 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:12.308040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-936a3e4f-86fd-4ff4-bedd-702fd4cb9b56 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:12.308890 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-936a3e4f-86fd-4ff4-bedd-702fd4cb9b56 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:12.309842 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-936a3e4f-86fd-4ff4-bedd-702fd4cb9b56 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:12.310434 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-936a3e4f-86fd-4ff4-bedd-702fd4cb9b56 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:12.563282 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-936a3e4f-86fd-4ff4-bedd-702fd4cb9b56 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:12.571427 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-936a3e4f-86fd-4ff4-bedd-702fd4cb9b56 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1503 microversion: 2.1 time: 0.276356 Jul 04 08:12:12.572217 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 591/1109] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:12 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:13.590423 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-da285f78-ff2c-4bf0-aeed-994c7dcc5a3f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:13.591015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-da285f78-ff2c-4bf0-aeed-994c7dcc5a3f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:13.598376 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-da285f78-ff2c-4bf0-aeed-994c7dcc5a3f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:13.599053 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-da285f78-ff2c-4bf0-aeed-994c7dcc5a3f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:13.599903 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-da285f78-ff2c-4bf0-aeed-994c7dcc5a3f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:13.600572 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-da285f78-ff2c-4bf0-aeed-994c7dcc5a3f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:13.619389 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:12:13.845342 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-da285f78-ff2c-4bf0-aeed-994c7dcc5a3f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:13.856364 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-da285f78-ff2c-4bf0-aeed-994c7dcc5a3f tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1503 microversion: 2.1 time: 0.270580 Jul 04 08:12:13.857249 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 519/1110] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:13 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1503 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:14.875837 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ed7bbfa8-a662-4dd8-b729-30e451f74483 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:14.876605 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ed7bbfa8-a662-4dd8-b729-30e451f74483 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:14.888963 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ed7bbfa8-a662-4dd8-b729-30e451f74483 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:14.892498 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ed7bbfa8-a662-4dd8-b729-30e451f74483 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:14.894792 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ed7bbfa8-a662-4dd8-b729-30e451f74483 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:14.895276 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ed7bbfa8-a662-4dd8-b729-30e451f74483 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:15.242066 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ed7bbfa8-a662-4dd8-b729-30e451f74483 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0224639fe5d24820bdead1bba468ddda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfb2bf1afead415b9d6ee79ad836197d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:15.250771 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ed7bbfa8-a662-4dd8-b729-30e451f74483 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 200 len: 1503 microversion: 2.1 time: 0.380039 Jul 04 08:12:15.251352 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 592/1111] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:14 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:15.310545 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-609a283d-bf13-4896-86db-9425aa5429cd req-dd88f618-81bc-4dd5-bd93-e8de9923eb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "771716ec-2377-407f-b6b9-ed2259350710", "name": "network-vif-deleted", "tag": "88ee4c7e-f9df-4bb2-a375-a5c184faebbf"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:12:15.323276 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-609a283d-bf13-4896-86db-9425aa5429cd req-dd88f618-81bc-4dd5-bd93-e8de9923eb7b service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:15.324463 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-609a283d-bf13-4896-86db-9425aa5429cd req-dd88f618-81bc-4dd5-bd93-e8de9923eb7b service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:15.350951 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-609a283d-bf13-4896-86db-9425aa5429cd req-dd88f618-81bc-4dd5-bd93-e8de9923eb7b service nova] Creating event network-vif-deleted:88ee4c7e-f9df-4bb2-a375-a5c184faebbf for instance 771716ec-2377-407f-b6b9-ed2259350710 on hv-cinder-79760 Jul 04 08:12:15.358914 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-609a283d-bf13-4896-86db-9425aa5429cd req-dd88f618-81bc-4dd5-bd93-e8de9923eb7b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054482 Jul 04 08:12:15.359850 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 520/1112] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:12:16.269074 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:16.271104 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] [instance: 771716ec-2377-407f-b6b9-ed2259350710] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:16.278415 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:16.278926 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:16.279767 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:16.280274 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:16.298385 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] HTTP exception thrown: Instance 771716ec-2377-407f-b6b9-ed2259350710 could not be found. Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Request method failure captured: Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 HTTP/1.1 Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwqCoBmKPJ9OADLMucknfigI45VQDAL4qOj6QnYlTG2Ic8xljoWz88hnEHcxsflYlKEUOHhPBY1eiwouHq78YVtkRCrEcuOLcOBElGwP8ZeKuf9mh-k0u14KQJiySwA7Onboxcxte8eeUBCK6e3LsNrh6EGRokIduA_XjkahcNrqm4DM Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: bfb2bf1afead415b9d6ee79ad836197d Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesActionsTest-1893288421 Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:12:16.300084 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bfb2bf1afead415b9d6ee79ad836197d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/bfb2bf1afead415b9d6ee79ad836197d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/bfb2bf1afead415b9d6ee79ad836197d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_bfb2bf1afead415b9d6ee79ad836197d", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesActionsTest-1893288421 Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: bfb2bf1afead415b9d6ee79ad836197d Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesActionsTest-1893288421 Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesActionsTest-1893288421-project Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: 0224639fe5d24820bdead1bba468ddda Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesActionsTest-1893288421-project Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 771716ec-2377-407f-b6b9-ed2259350710 could not be found. Jul 04 08:12:16.302142 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '771716ec-2377-407f-b6b9-ed2259350710'} Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 771716ec-2377-407f-b6b9-ed2259350710 could not be found. Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:12:16.303108 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 771716ec-2377-407f-b6b9-ed2259350710 could not be found. Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 771716ec-2377-407f-b6b9-ed2259350710 could not be found. Jul 04 08:12:16.304760 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:12:16.307204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] Returning 404 to user: Instance 771716ec-2377-407f-b6b9-ed2259350710 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:12:16.308386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a0f6dcf0-d69a-4482-9987-640698c796a7 tempest-VolumesActionsTest-1893288421 tempest-VolumesActionsTest-1893288421-project] 10.222.0.43 "GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710" status: 404 len: 111 microversion: 2.1 time: 0.043955 Jul 04 08:12:16.308960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 593/1113] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:16 2022] GET /compute/v2.1/servers/771716ec-2377-407f-b6b9-ed2259350710 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 08:12:38.387860 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:12:38.388706 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=5 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:12:38.397966 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1273176190", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1698566224", "security_groups": [{"name": "tempest-secgroup-smoke-1279218911"}], "block_device_mapping_v2": [{"uuid": "fae43508-67dc-4482-a424-01887fe0b768", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ae013d11-69a5-488a-bc48-9896b5be9f9a"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:12:38.566931 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] validate_networks() for [('ae013d11-69a5-488a-bc48-9896b5be9f9a', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:12:39.142318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:12:39.144205 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:12:39.145376 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:12:39.146869 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:12:39.147886 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:12:39.170276 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:39.172334 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:39.174868 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:39.176137 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:39.203215 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Getting quotas for project d1b0f9c7bc044f6c802c8cd34da4eb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:12:39.208465 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Getting quotas for user fa28f0e0b3b0488faf7db7bf7dc3854b and project d1b0f9c7bc044f6c802c8cd34da4eb0e. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:12:39.302427 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:12:39.307051 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fae43508-67dc-4482-a424-01887fe0b768',volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:12:39.526218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9e831ce2-70be-485f-8785-7cd8eb219168 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.139982 Jul 04 08:12:39.533952 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 521/1114] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:12:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:12:39.540204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c64d310a-2ffc-4e19-8dd5-f46b1b844c3a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:39.541416 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c64d310a-2ffc-4e19-8dd5-f46b1b844c3a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:39.543881 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=33 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:12:39.544516 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=89 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:12:39.982922 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c64d310a-2ffc-4e19-8dd5-f46b1b844c3a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:39.990640 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c64d310a-2ffc-4e19-8dd5-f46b1b844c3a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1095 microversion: 2.1 time: 0.455042 Jul 04 08:12:39.991483 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 594/1115] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:39 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1095 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:12:41.015691 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-507ef288-0ca4-45e5-8cde-a54123b3f5e9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:41.022227 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-507ef288-0ca4-45e5-8cde-a54123b3f5e9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:41.050686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-507ef288-0ca4-45e5-8cde-a54123b3f5e9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:41.051884 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-507ef288-0ca4-45e5-8cde-a54123b3f5e9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:41.053490 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-507ef288-0ca4-45e5-8cde-a54123b3f5e9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:41.054358 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-507ef288-0ca4-45e5-8cde-a54123b3f5e9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:41.317054 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-507ef288-0ca4-45e5-8cde-a54123b3f5e9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:41.333503 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-507ef288-0ca4-45e5-8cde-a54123b3f5e9 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1201 microversion: 2.1 time: 0.326393 Jul 04 08:12:41.336639 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 522/1116] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:41 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1201 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:42.360923 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3acd57f6-ca14-42d2-bb53-47d7d9901e3c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:42.361683 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3acd57f6-ca14-42d2-bb53-47d7d9901e3c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:42.374426 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3acd57f6-ca14-42d2-bb53-47d7d9901e3c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:42.374888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3acd57f6-ca14-42d2-bb53-47d7d9901e3c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:42.375722 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3acd57f6-ca14-42d2-bb53-47d7d9901e3c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:42.376206 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3acd57f6-ca14-42d2-bb53-47d7d9901e3c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:42.603126 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3acd57f6-ca14-42d2-bb53-47d7d9901e3c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:42.616053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3acd57f6-ca14-42d2-bb53-47d7d9901e3c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1279 microversion: 2.1 time: 0.259679 Jul 04 08:12:42.626960 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 595/1117] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:42 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1279 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:12:43.303278 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-93b3dcfe-b271-49bb-a5d1-26d191dbefe2 req-fbd9d2bb-776c-4319-9db7-5c0f86007162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3357a4e-9590-4c32-87ac-85b781b6c9dc", "tag": "1d25461c-f06e-4eea-b273-0810acd24dd5"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:12:43.352818 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-93b3dcfe-b271-49bb-a5d1-26d191dbefe2 req-fbd9d2bb-776c-4319-9db7-5c0f86007162 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:43.354250 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-93b3dcfe-b271-49bb-a5d1-26d191dbefe2 req-fbd9d2bb-776c-4319-9db7-5c0f86007162 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:43.374133 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-93b3dcfe-b271-49bb-a5d1-26d191dbefe2 req-fbd9d2bb-776c-4319-9db7-5c0f86007162 service nova] Creating event network-changed:1d25461c-f06e-4eea-b273-0810acd24dd5 for instance a3357a4e-9590-4c32-87ac-85b781b6c9dc on hv-cinder-79760 Jul 04 08:12:43.381722 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-93b3dcfe-b271-49bb-a5d1-26d191dbefe2 req-fbd9d2bb-776c-4319-9db7-5c0f86007162 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094116 Jul 04 08:12:43.383315 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 523/1118] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:12:43.639865 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a863d396-d364-4e97-9d7c-ecda05abea50 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:43.639865 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a863d396-d364-4e97-9d7c-ecda05abea50 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:43.646266 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a863d396-d364-4e97-9d7c-ecda05abea50 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:43.646873 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a863d396-d364-4e97-9d7c-ecda05abea50 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:43.647936 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a863d396-d364-4e97-9d7c-ecda05abea50 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:43.648615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a863d396-d364-4e97-9d7c-ecda05abea50 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:43.802867 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a863d396-d364-4e97-9d7c-ecda05abea50 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:43.811538 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a863d396-d364-4e97-9d7c-ecda05abea50 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.179980 Jul 04 08:12:43.812133 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 596/1119] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:43 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:44.832231 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-9ca0e50e-4980-4a14-b548-b5a22c83c67c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:44.832989 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-9ca0e50e-4980-4a14-b548-b5a22c83c67c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:44.843945 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9ca0e50e-4980-4a14-b548-b5a22c83c67c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:44.844406 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9ca0e50e-4980-4a14-b548-b5a22c83c67c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:44.845215 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9ca0e50e-4980-4a14-b548-b5a22c83c67c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:44.845671 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-9ca0e50e-4980-4a14-b548-b5a22c83c67c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:45.010546 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-9ca0e50e-4980-4a14-b548-b5a22c83c67c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:45.019760 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-9ca0e50e-4980-4a14-b548-b5a22c83c67c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.192979 Jul 04 08:12:45.020726 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 524/1120] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:44 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:46.037915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-041fcbd6-8ecd-454c-bd90-d3e8447c58e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:46.038587 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-041fcbd6-8ecd-454c-bd90-d3e8447c58e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:46.045692 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-041fcbd6-8ecd-454c-bd90-d3e8447c58e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:46.046228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-041fcbd6-8ecd-454c-bd90-d3e8447c58e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:46.047210 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-041fcbd6-8ecd-454c-bd90-d3e8447c58e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:46.047645 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-041fcbd6-8ecd-454c-bd90-d3e8447c58e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:46.196297 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-041fcbd6-8ecd-454c-bd90-d3e8447c58e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:46.204967 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-041fcbd6-8ecd-454c-bd90-d3e8447c58e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.171266 Jul 04 08:12:46.205551 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 597/1121] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:46 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:47.223011 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-88bd0ac0-2e8f-4c4d-b7bf-d48880782a15 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:47.223627 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-88bd0ac0-2e8f-4c4d-b7bf-d48880782a15 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:47.230761 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88bd0ac0-2e8f-4c4d-b7bf-d48880782a15 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:47.231173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88bd0ac0-2e8f-4c4d-b7bf-d48880782a15 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:47.232189 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88bd0ac0-2e8f-4c4d-b7bf-d48880782a15 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:47.232815 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-88bd0ac0-2e8f-4c4d-b7bf-d48880782a15 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:47.410775 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-88bd0ac0-2e8f-4c4d-b7bf-d48880782a15 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:47.418943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-88bd0ac0-2e8f-4c4d-b7bf-d48880782a15 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.199850 Jul 04 08:12:47.419512 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 525/1122] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:47 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:48.440863 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-946ab2c7-2cfc-4f27-b18b-6a20dfa44240 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:48.441489 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-946ab2c7-2cfc-4f27-b18b-6a20dfa44240 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:48.448005 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-946ab2c7-2cfc-4f27-b18b-6a20dfa44240 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:48.448804 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-946ab2c7-2cfc-4f27-b18b-6a20dfa44240 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:48.450164 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-946ab2c7-2cfc-4f27-b18b-6a20dfa44240 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:48.450742 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-946ab2c7-2cfc-4f27-b18b-6a20dfa44240 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:48.623976 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-946ab2c7-2cfc-4f27-b18b-6a20dfa44240 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:48.632353 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-946ab2c7-2cfc-4f27-b18b-6a20dfa44240 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.196777 Jul 04 08:12:48.632961 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 598/1123] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:48 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:49.656446 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a3333516-23cc-4248-a519-f906838f3fa2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:49.657499 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a3333516-23cc-4248-a519-f906838f3fa2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:49.666107 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:12:49.667600 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:12:49.676514 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3333516-23cc-4248-a519-f906838f3fa2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:49.677244 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3333516-23cc-4248-a519-f906838f3fa2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:49.678554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3333516-23cc-4248-a519-f906838f3fa2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:49.679383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a3333516-23cc-4248-a519-f906838f3fa2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:49.853484 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a3333516-23cc-4248-a519-f906838f3fa2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:49.861844 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a3333516-23cc-4248-a519-f906838f3fa2 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.213325 Jul 04 08:12:49.862414 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 526/1124] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:49 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:50.878539 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a6ee6692-e566-4d45-8cef-6a0664a64e2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:50.879102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a6ee6692-e566-4d45-8cef-6a0664a64e2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:50.881510 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:12:50.886919 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a6ee6692-e566-4d45-8cef-6a0664a64e2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:50.887375 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a6ee6692-e566-4d45-8cef-6a0664a64e2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:50.888464 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a6ee6692-e566-4d45-8cef-6a0664a64e2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:50.888898 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a6ee6692-e566-4d45-8cef-6a0664a64e2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:51.037992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a6ee6692-e566-4d45-8cef-6a0664a64e2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:51.054193 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a6ee6692-e566-4d45-8cef-6a0664a64e2a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.179672 Jul 04 08:12:51.054834 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 599/1125] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:50 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:52.071925 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-7c150994-2357-4da3-8c41-3e5c9327ab61 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:52.072505 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-7c150994-2357-4da3-8c41-3e5c9327ab61 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:52.079582 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7c150994-2357-4da3-8c41-3e5c9327ab61 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:52.080041 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7c150994-2357-4da3-8c41-3e5c9327ab61 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:52.080980 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7c150994-2357-4da3-8c41-3e5c9327ab61 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:52.081410 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-7c150994-2357-4da3-8c41-3e5c9327ab61 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:52.229539 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-7c150994-2357-4da3-8c41-3e5c9327ab61 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:52.242843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-7c150994-2357-4da3-8c41-3e5c9327ab61 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.169935 Jul 04 08:12:52.242843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 527/1126] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:52 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:53.257898 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8271245c-cab0-43d4-865d-6fe9d3e6edf7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:53.258530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8271245c-cab0-43d4-865d-6fe9d3e6edf7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:53.268259 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8271245c-cab0-43d4-865d-6fe9d3e6edf7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:53.268830 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8271245c-cab0-43d4-865d-6fe9d3e6edf7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:53.269604 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8271245c-cab0-43d4-865d-6fe9d3e6edf7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:53.270068 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8271245c-cab0-43d4-865d-6fe9d3e6edf7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:53.424306 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8271245c-cab0-43d4-865d-6fe9d3e6edf7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:53.433118 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8271245c-cab0-43d4-865d-6fe9d3e6edf7 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.182051 Jul 04 08:12:53.443992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 600/1127] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:53 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:53.518557 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-68ffd5de-596b-4e60-a25e-4bef5ff0cd22 req-d2105d22-0034-49c0-a153-50f62c8d717a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3357a4e-9590-4c32-87ac-85b781b6c9dc", "name": "network-vif-plugged", "status": "completed", "tag": "1d25461c-f06e-4eea-b273-0810acd24dd5"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:12:53.527412 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-68ffd5de-596b-4e60-a25e-4bef5ff0cd22 req-d2105d22-0034-49c0-a153-50f62c8d717a service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:53.527788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-68ffd5de-596b-4e60-a25e-4bef5ff0cd22 req-d2105d22-0034-49c0-a153-50f62c8d717a service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:53.542317 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-68ffd5de-596b-4e60-a25e-4bef5ff0cd22 req-d2105d22-0034-49c0-a153-50f62c8d717a service nova] Creating event network-vif-plugged:1d25461c-f06e-4eea-b273-0810acd24dd5 for instance a3357a4e-9590-4c32-87ac-85b781b6c9dc on hv-cinder-79760 Jul 04 08:12:53.547727 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-68ffd5de-596b-4e60-a25e-4bef5ff0cd22 req-d2105d22-0034-49c0-a153-50f62c8d717a service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032891 Jul 04 08:12:53.548598 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 528/1128] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:12:54.451494 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-23c71a9e-5135-4ba9-84c0-91ae8fe04a76 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:54.452041 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-23c71a9e-5135-4ba9-84c0-91ae8fe04a76 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:54.459341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23c71a9e-5135-4ba9-84c0-91ae8fe04a76 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:54.459731 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23c71a9e-5135-4ba9-84c0-91ae8fe04a76 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:54.460521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23c71a9e-5135-4ba9-84c0-91ae8fe04a76 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:54.461165 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-23c71a9e-5135-4ba9-84c0-91ae8fe04a76 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:54.717716 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-23c71a9e-5135-4ba9-84c0-91ae8fe04a76 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:54.725597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-23c71a9e-5135-4ba9-84c0-91ae8fe04a76 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1267 microversion: 2.1 time: 0.278403 Jul 04 08:12:54.726504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 601/1129] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:54 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:55.744047 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-08def146-d8c0-430f-b406-f10cab14d0e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:55.745434 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-08def146-d8c0-430f-b406-f10cab14d0e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:55.751692 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08def146-d8c0-430f-b406-f10cab14d0e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:55.752134 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08def146-d8c0-430f-b406-f10cab14d0e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:55.753260 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08def146-d8c0-430f-b406-f10cab14d0e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:55.754121 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-08def146-d8c0-430f-b406-f10cab14d0e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:55.905075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-08def146-d8c0-430f-b406-f10cab14d0e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:55.914773 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-08def146-d8c0-430f-b406-f10cab14d0e8 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1454 microversion: 2.1 time: 0.175338 Jul 04 08:12:55.915368 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 529/1130] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:55 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:55.933412 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-18db9fcf-d0d5-45f6-a524-d6aee607935d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:12:55.934773 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-18db9fcf-d0d5-45f6-a524-d6aee607935d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:12:55.942170 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18db9fcf-d0d5-45f6-a524-d6aee607935d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:55.950958 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18db9fcf-d0d5-45f6-a524-d6aee607935d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:55.951877 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18db9fcf-d0d5-45f6-a524-d6aee607935d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:55.952327 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18db9fcf-d0d5-45f6-a524-d6aee607935d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:56.106150 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-18db9fcf-d0d5-45f6-a524-d6aee607935d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:12:56.115432 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-18db9fcf-d0d5-45f6-a524-d6aee607935d tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1454 microversion: 2.1 time: 0.186318 Jul 04 08:12:56.116016 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 602/1131] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:12:55 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:12:58.514946 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-f55f5f35-f2a8-4b99-8eb2-832b11675371 req-b69e92cb-4244-451b-b84c-6eac24174a89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3357a4e-9590-4c32-87ac-85b781b6c9dc", "tag": "1d25461c-f06e-4eea-b273-0810acd24dd5"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:12:58.525465 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f55f5f35-f2a8-4b99-8eb2-832b11675371 req-b69e92cb-4244-451b-b84c-6eac24174a89 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:12:58.526032 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-f55f5f35-f2a8-4b99-8eb2-832b11675371 req-b69e92cb-4244-451b-b84c-6eac24174a89 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:12:58.538478 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-f55f5f35-f2a8-4b99-8eb2-832b11675371 req-b69e92cb-4244-451b-b84c-6eac24174a89 service nova] Creating event network-changed:1d25461c-f06e-4eea-b273-0810acd24dd5 for instance a3357a4e-9590-4c32-87ac-85b781b6c9dc on hv-cinder-79760 Jul 04 08:12:58.549436 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-f55f5f35-f2a8-4b99-8eb2-832b11675371 req-b69e92cb-4244-451b-b84c-6eac24174a89 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036820 Jul 04 08:12:58.552720 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 530/1132] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:13:42.362757 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-79be2f52-6564-41a5-871b-96c7d8d55bb5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Action: 'create', calling method: .version_select at 0x7f05e5562430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2114917443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNoRyD/TgHtV+iB+wq825SPC01OmNznmnN9V5bK5v7CODRhnGGR+91TFwcUmyw+zMFNFSd/7cWPAGRqp9Yfp98BWg+fhmegoWhwVjpYg/K9W9gz7uK1XBWB4XDnTGJcg8Q=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:13:42.366858 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=20 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:13:42.367530 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=48 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:13:42.380296 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-79be2f52-6564-41a5-871b-96c7d8d55bb5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Getting quotas for project fea21868e80c43aa81d1a9d277da4e9d. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:13:42.384416 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-79be2f52-6564-41a5-871b-96c7d8d55bb5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Getting quotas for user c11b4c72af804f68ad2bc19e91f11129 and project fea21868e80c43aa81d1a9d277da4e9d. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:13:42.398487 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-79be2f52-6564-41a5-871b-96c7d8d55bb5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [1de3c88b-15bd-4a2e-8367-fa50ffd7b6d6] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 08:13:43.408588 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [None req-79be2f52-6564-41a5-871b-96c7d8d55bb5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [1de3c88b-15bd-4a2e-8367-fa50ffd7b6d6] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 57392. Jul 04 08:13:43.429768 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-79be2f52-6564-41a5-871b-96c7d8d55bb5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 1.070549 Jul 04 08:13:43.430588 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 603/1133] 10.222.0.43 () {60 vars in 1158 bytes} [Mon Jul 4 08:13:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:13:43.482386 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:13:43.483639 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=44 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:13:43.487857 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-189990334", "imageRef": "d12170a5-91c3-46d1-babe-e9ed50452dbd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2114917443", "networks": [{"uuid": "d64c1b09-fe73-430f-b646-85fbc938edd7"}]}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:13:43.662853 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.network.neutron [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] validate_networks() for [('d64c1b09-fe73-430f-b646-85fbc938edd7', None, None, None, None, None)] {{(pid=117870) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 04 08:13:44.074537 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Flavor limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 04 08:13:44.074961 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Image limits 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 04 08:13:44.075440 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Flavor pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 04 08:13:44.075850 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Image pref 0:0:0 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 04 08:13:44.076420 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.virt.hardware [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117870) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 04 08:13:44.085797 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:44.086279 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:44.087071 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:44.087501 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:44.105102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Getting quotas for project fea21868e80c43aa81d1a9d277da4e9d. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 04 08:13:44.109589 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.quota [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Getting quotas for user c11b4c72af804f68ad2bc19e91f11129 and project fea21868e80c43aa81d1a9d277da4e9d. Resources: {'cores', 'instances', 'ram'} {{(pid=117870) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 04 08:13:44.121383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Going to run 1 instances... {{(pid=117870) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 04 08:13:44.123854 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d12170a5-91c3-46d1-babe-e9ed50452dbd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117870) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 04 08:13:44.176081 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-d1068ccd-2379-45ad-b789-49a7035cf95e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695090 Jul 04 08:13:44.177172 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 531/1134] 10.222.0.43 () {60 vars in 1146 bytes} [Mon Jul 4 08:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 04 08:13:44.191749 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7067950e-573d-4028-b53f-f7f4a2292f6e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:44.193094 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7067950e-573d-4028-b53f-f7f4a2292f6e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:44.404886 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7067950e-573d-4028-b53f-f7f4a2292f6e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:44.415184 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7067950e-573d-4028-b53f-f7f4a2292f6e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1258 microversion: 2.1 time: 0.228183 Jul 04 08:13:44.416146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 604/1135] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:44 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1258 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:45.440223 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1036085b-95c6-409a-921d-c9c139f2fa0f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:45.441097 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1036085b-95c6-409a-921d-c9c139f2fa0f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:45.453159 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1036085b-95c6-409a-921d-c9c139f2fa0f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:45.454413 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1036085b-95c6-409a-921d-c9c139f2fa0f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:45.455864 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1036085b-95c6-409a-921d-c9c139f2fa0f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:45.456803 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1036085b-95c6-409a-921d-c9c139f2fa0f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:45.581608 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1036085b-95c6-409a-921d-c9c139f2fa0f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:45.590017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1036085b-95c6-409a-921d-c9c139f2fa0f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1328 microversion: 2.1 time: 0.157951 Jul 04 08:13:45.597681 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 532/1136] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:45 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1328 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:13:46.613780 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab44f24d-f135-4588-bc00-7d5650d4aa5c tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:46.616065 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ab44f24d-f135-4588-bc00-7d5650d4aa5c tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:46.640374 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab44f24d-f135-4588-bc00-7d5650d4aa5c tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:46.641794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab44f24d-f135-4588-bc00-7d5650d4aa5c tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:46.643564 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab44f24d-f135-4588-bc00-7d5650d4aa5c tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:46.644697 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab44f24d-f135-4588-bc00-7d5650d4aa5c tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:46.849648 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ab44f24d-f135-4588-bc00-7d5650d4aa5c tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:46.858153 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ab44f24d-f135-4588-bc00-7d5650d4aa5c tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.251312 Jul 04 08:13:46.859845 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 605/1137] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:46 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:47.882143 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b9541683-95a5-494a-adbe-6abeb7a32230 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:47.883684 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b9541683-95a5-494a-adbe-6abeb7a32230 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:47.898949 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b9541683-95a5-494a-adbe-6abeb7a32230 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:47.900292 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b9541683-95a5-494a-adbe-6abeb7a32230 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:47.903278 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b9541683-95a5-494a-adbe-6abeb7a32230 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:47.904932 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b9541683-95a5-494a-adbe-6abeb7a32230 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:48.131192 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b9541683-95a5-494a-adbe-6abeb7a32230 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:48.140420 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b9541683-95a5-494a-adbe-6abeb7a32230 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.264154 Jul 04 08:13:48.141330 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 533/1138] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:47 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:13:49.160901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a94d20a0-6f96-42b1-a76a-09d5907740de tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:49.162778 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a94d20a0-6f96-42b1-a76a-09d5907740de tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:49.176436 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a94d20a0-6f96-42b1-a76a-09d5907740de tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:49.177311 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a94d20a0-6f96-42b1-a76a-09d5907740de tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:49.179397 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a94d20a0-6f96-42b1-a76a-09d5907740de tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:49.180231 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a94d20a0-6f96-42b1-a76a-09d5907740de tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:49.393869 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a94d20a0-6f96-42b1-a76a-09d5907740de tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:49.404182 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a94d20a0-6f96-42b1-a76a-09d5907740de tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.248791 Jul 04 08:13:49.405687 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 606/1139] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:49 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:50.217250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 08:13:50.218188 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Mon Jul 4 08:13:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 08:13:50.428383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-035ab0c8-fb14-4362-9011-3a52f07972b6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:50.429391 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-035ab0c8-fb14-4362-9011-3a52f07972b6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:50.446477 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-035ab0c8-fb14-4362-9011-3a52f07972b6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:50.446477 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-035ab0c8-fb14-4362-9011-3a52f07972b6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:50.446477 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-035ab0c8-fb14-4362-9011-3a52f07972b6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:50.446477 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-035ab0c8-fb14-4362-9011-3a52f07972b6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:50.606136 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-035ab0c8-fb14-4362-9011-3a52f07972b6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:50.614879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-035ab0c8-fb14-4362-9011-3a52f07972b6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.194461 Jul 04 08:13:50.615829 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 534/1140] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:50 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:51.641181 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-20f5f18c-0ec2-426b-84e1-bdd200828b7e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:51.641875 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-20f5f18c-0ec2-426b-84e1-bdd200828b7e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:51.649775 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20f5f18c-0ec2-426b-84e1-bdd200828b7e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:51.650249 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20f5f18c-0ec2-426b-84e1-bdd200828b7e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:51.651076 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20f5f18c-0ec2-426b-84e1-bdd200828b7e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:51.651441 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-20f5f18c-0ec2-426b-84e1-bdd200828b7e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:51.831035 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-20f5f18c-0ec2-426b-84e1-bdd200828b7e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:51.841606 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-20f5f18c-0ec2-426b-84e1-bdd200828b7e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.205019 Jul 04 08:13:51.852961 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 607/1141] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:51 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:52.869020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0ec1de65-cc69-4ce3-ad45-0d2c06c1e236 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:52.869986 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0ec1de65-cc69-4ce3-ad45-0d2c06c1e236 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:52.877003 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ec1de65-cc69-4ce3-ad45-0d2c06c1e236 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:52.877415 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ec1de65-cc69-4ce3-ad45-0d2c06c1e236 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:52.878565 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ec1de65-cc69-4ce3-ad45-0d2c06c1e236 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:52.879029 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ec1de65-cc69-4ce3-ad45-0d2c06c1e236 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:53.039026 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-0ec1de65-cc69-4ce3-ad45-0d2c06c1e236 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:53.048397 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0ec1de65-cc69-4ce3-ad45-0d2c06c1e236 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.184121 Jul 04 08:13:53.049010 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 535/1142] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:52 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:54.074482 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9e7deee3-6427-49f0-bf40-69ab57a6bbdf tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:54.075386 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9e7deee3-6427-49f0-bf40-69ab57a6bbdf tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:54.083155 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9e7deee3-6427-49f0-bf40-69ab57a6bbdf tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:54.083591 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9e7deee3-6427-49f0-bf40-69ab57a6bbdf tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:54.084391 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9e7deee3-6427-49f0-bf40-69ab57a6bbdf tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:54.084821 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9e7deee3-6427-49f0-bf40-69ab57a6bbdf tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:54.268081 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9e7deee3-6427-49f0-bf40-69ab57a6bbdf tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:54.276738 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9e7deee3-6427-49f0-bf40-69ab57a6bbdf tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.206238 Jul 04 08:13:54.277333 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 608/1143] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:54 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:55.295521 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-52d346a4-ebb1-4f08-b70b-53091c278a6d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:55.296502 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-52d346a4-ebb1-4f08-b70b-53091c278a6d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:55.299320 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:13:55.300143 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell0:SELECT=6 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:13:55.307171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-52d346a4-ebb1-4f08-b70b-53091c278a6d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:55.307686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-52d346a4-ebb1-4f08-b70b-53091c278a6d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:55.308542 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-52d346a4-ebb1-4f08-b70b-53091c278a6d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:55.309042 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-52d346a4-ebb1-4f08-b70b-53091c278a6d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:55.400521 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-56b1d747-f3c8-408e-868f-0732b39f34c5 req-c9e0862a-2d7b-4294-a649-82b930489da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd2b4ce-89f3-40e8-9840-487fc646456b", "tag": "d63ec938-97a9-4e67-822a-e96d42a2c118"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:13:55.405397 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:13:55.412299 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-56b1d747-f3c8-408e-868f-0732b39f34c5 req-c9e0862a-2d7b-4294-a649-82b930489da1 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:55.412805 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-56b1d747-f3c8-408e-868f-0732b39f34c5 req-c9e0862a-2d7b-4294-a649-82b930489da1 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:55.430263 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-56b1d747-f3c8-408e-868f-0732b39f34c5 req-c9e0862a-2d7b-4294-a649-82b930489da1 service nova] Creating event network-changed:d63ec938-97a9-4e67-822a-e96d42a2c118 for instance 7bd2b4ce-89f3-40e8-9840-487fc646456b on hv-cinder-79760 Jul 04 08:13:55.436539 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-56b1d747-f3c8-408e-868f-0732b39f34c5 req-c9e0862a-2d7b-4294-a649-82b930489da1 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040087 Jul 04 08:13:55.438129 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 609/1144] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:13:55.553135 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-52d346a4-ebb1-4f08-b70b-53091c278a6d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:55.563580 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-52d346a4-ebb1-4f08-b70b-53091c278a6d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.272677 Jul 04 08:13:55.564176 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 536/1145] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:55 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:56.582655 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-53e8ed56-c858-4caf-a45b-9d0ec2c6619d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:56.583400 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-53e8ed56-c858-4caf-a45b-9d0ec2c6619d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:56.590632 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53e8ed56-c858-4caf-a45b-9d0ec2c6619d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:56.591075 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53e8ed56-c858-4caf-a45b-9d0ec2c6619d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:56.592014 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53e8ed56-c858-4caf-a45b-9d0ec2c6619d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:56.592428 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53e8ed56-c858-4caf-a45b-9d0ec2c6619d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:56.743363 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-53e8ed56-c858-4caf-a45b-9d0ec2c6619d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:56.751672 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-53e8ed56-c858-4caf-a45b-9d0ec2c6619d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.173998 Jul 04 08:13:56.752266 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 610/1146] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:56 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:57.770676 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-bf3d769a-c811-4a9e-ad52-e5b20cb8c603 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:57.772697 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-bf3d769a-c811-4a9e-ad52-e5b20cb8c603 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:57.778154 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf3d769a-c811-4a9e-ad52-e5b20cb8c603 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:57.778594 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf3d769a-c811-4a9e-ad52-e5b20cb8c603 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:57.779398 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf3d769a-c811-4a9e-ad52-e5b20cb8c603 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:57.779843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-bf3d769a-c811-4a9e-ad52-e5b20cb8c603 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:57.963040 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-bf3d769a-c811-4a9e-ad52-e5b20cb8c603 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:57.972353 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-bf3d769a-c811-4a9e-ad52-e5b20cb8c603 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.205967 Jul 04 08:13:57.972970 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 537/1147] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:57 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:58.992457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d9b36bc3-f4b5-4017-995d-1e7b4d811b28 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:13:58.993596 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d9b36bc3-f4b5-4017-995d-1e7b4d811b28 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:13:59.003233 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9b36bc3-f4b5-4017-995d-1e7b4d811b28 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:59.003809 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9b36bc3-f4b5-4017-995d-1e7b4d811b28 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:59.004826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9b36bc3-f4b5-4017-995d-1e7b4d811b28 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:59.005364 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d9b36bc3-f4b5-4017-995d-1e7b4d811b28 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:59.170209 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d9b36bc3-f4b5-4017-995d-1e7b4d811b28 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:13:59.178637 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d9b36bc3-f4b5-4017-995d-1e7b4d811b28 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.191425 Jul 04 08:13:59.179251 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 611/1148] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:13:58 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:13:59.762692 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-c0cfa404-67a6-4e61-a9ff-079ab68e7b3a req-44e9a1a9-e046-49c0-b396-b9f50392c5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd2b4ce-89f3-40e8-9840-487fc646456b", "name": "network-vif-plugged", "status": "completed", "tag": "d63ec938-97a9-4e67-822a-e96d42a2c118"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:13:59.772361 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c0cfa404-67a6-4e61-a9ff-079ab68e7b3a req-44e9a1a9-e046-49c0-b396-b9f50392c5e3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:13:59.772804 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-c0cfa404-67a6-4e61-a9ff-079ab68e7b3a req-44e9a1a9-e046-49c0-b396-b9f50392c5e3 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:13:59.785285 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-c0cfa404-67a6-4e61-a9ff-079ab68e7b3a req-44e9a1a9-e046-49c0-b396-b9f50392c5e3 service nova] Creating event network-vif-plugged:d63ec938-97a9-4e67-822a-e96d42a2c118 for instance 7bd2b4ce-89f3-40e8-9840-487fc646456b on hv-cinder-79760 Jul 04 08:13:59.790726 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-c0cfa404-67a6-4e61-a9ff-079ab68e7b3a req-44e9a1a9-e046-49c0-b396-b9f50392c5e3 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031995 Jul 04 08:13:59.791349 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 538/1149] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:14:00.198571 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-919e1ad5-8024-4f14-9135-0d96bd539df6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:00.199235 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-919e1ad5-8024-4f14-9135-0d96bd539df6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:00.206061 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-919e1ad5-8024-4f14-9135-0d96bd539df6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:00.206504 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-919e1ad5-8024-4f14-9135-0d96bd539df6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:00.207281 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-919e1ad5-8024-4f14-9135-0d96bd539df6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:00.207709 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-919e1ad5-8024-4f14-9135-0d96bd539df6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:00.360836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-919e1ad5-8024-4f14-9135-0d96bd539df6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:00.369531 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-919e1ad5-8024-4f14-9135-0d96bd539df6 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.174904 Jul 04 08:14:00.370224 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 612/1150] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:00 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:14:01.392573 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-a17c2562-320b-40ea-aceb-0ee24a13c239 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:01.393152 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-a17c2562-320b-40ea-aceb-0ee24a13c239 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:01.400516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a17c2562-320b-40ea-aceb-0ee24a13c239 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:01.401109 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a17c2562-320b-40ea-aceb-0ee24a13c239 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:01.402130 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a17c2562-320b-40ea-aceb-0ee24a13c239 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:01.402843 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-a17c2562-320b-40ea-aceb-0ee24a13c239 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:01.550747 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-a17c2562-320b-40ea-aceb-0ee24a13c239 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:01.558806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-a17c2562-320b-40ea-aceb-0ee24a13c239 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1358 microversion: 2.1 time: 0.172785 Jul 04 08:14:01.559874 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 539/1151] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:01 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:02.583302 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-31466070-b3ac-43d3-b4af-71c7af28d288 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:02.583938 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-31466070-b3ac-43d3-b4af-71c7af28d288 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:02.591273 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31466070-b3ac-43d3-b4af-71c7af28d288 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:02.591726 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31466070-b3ac-43d3-b4af-71c7af28d288 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:02.593207 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31466070-b3ac-43d3-b4af-71c7af28d288 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:02.593681 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31466070-b3ac-43d3-b4af-71c7af28d288 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:02.745418 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-31466070-b3ac-43d3-b4af-71c7af28d288 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:02.753916 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-31466070-b3ac-43d3-b4af-71c7af28d288 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1547 microversion: 2.1 time: 0.174669 Jul 04 08:14:02.754497 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 613/1152] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:02 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:02.770823 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-58934f96-5b16-43d8-b11f-f8664ef4b62f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:02.771401 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-58934f96-5b16-43d8-b11f-f8664ef4b62f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:02.778305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58934f96-5b16-43d8-b11f-f8664ef4b62f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:02.778754 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58934f96-5b16-43d8-b11f-f8664ef4b62f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:02.779568 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58934f96-5b16-43d8-b11f-f8664ef4b62f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:02.779983 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-58934f96-5b16-43d8-b11f-f8664ef4b62f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:02.925712 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-58934f96-5b16-43d8-b11f-f8664ef4b62f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:02.933879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-58934f96-5b16-43d8-b11f-f8664ef4b62f tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1547 microversion: 2.1 time: 0.166834 Jul 04 08:14:02.934473 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 540/1153] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:02 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:02.950484 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5d4c1ba0-ed0b-483c-9973-e3f06dc36761 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:02.954466 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5d4c1ba0-ed0b-483c-9973-e3f06dc36761 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:02.955311 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5d4c1ba0-ed0b-483c-9973-e3f06dc36761 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Searching by: {'deleted': False, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d'} {{(pid=117871) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 04 08:14:02.962731 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d4c1ba0-ed0b-483c-9973-e3f06dc36761 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:02.963175 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d4c1ba0-ed0b-483c-9973-e3f06dc36761 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:02.963954 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d4c1ba0-ed0b-483c-9973-e3f06dc36761 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:02.964382 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d4c1ba0-ed0b-483c-9973-e3f06dc36761 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:03.062764 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.multi_cell_list [None req-5d4c1ba0-ed0b-483c-9973-e3f06dc36761 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117871) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 04 08:14:03.162451 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5d4c1ba0-ed0b-483c-9973-e3f06dc36761 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.215724 Jul 04 08:14:03.163016 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 614/1154] 10.222.0.43 () {58 vars in 1124 bytes} [Mon Jul 4 08:14:02 2022] GET /compute/v2.1/servers => generated 342 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:14:03.174591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-09ede290-fad2-4122-bcd4-d28ac9a64612 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:03.175320 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-09ede290-fad2-4122-bcd4-d28ac9a64612 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:03.182991 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09ede290-fad2-4122-bcd4-d28ac9a64612 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:03.183481 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09ede290-fad2-4122-bcd4-d28ac9a64612 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:03.184290 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09ede290-fad2-4122-bcd4-d28ac9a64612 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:03.184772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-09ede290-fad2-4122-bcd4-d28ac9a64612 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:03.331237 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-09ede290-fad2-4122-bcd4-d28ac9a64612 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:03.340005 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-09ede290-fad2-4122-bcd4-d28ac9a64612 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1547 microversion: 2.1 time: 0.169842 Jul 04 08:14:03.340612 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 541/1155] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:03 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:04.935892 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e5f32215-a138-4174-b9c7-75a7579d3b3d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "070f4e0d-8de7-406b-809d-ad735f5c6f21"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:14:04.937124 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e5f32215-a138-4174-b9c7-75a7579d3b3d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:04.944358 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e5f32215-a138-4174-b9c7-75a7579d3b3d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:04.944834 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e5f32215-a138-4174-b9c7-75a7579d3b3d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:04.945591 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e5f32215-a138-4174-b9c7-75a7579d3b3d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:04.946021 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e5f32215-a138-4174-b9c7-75a7579d3b3d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:05.253662 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e5f32215-a138-4174-b9c7-75a7579d3b3d tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "POST /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321241 Jul 04 08:14:05.254239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 615/1156] 10.222.0.43 () {60 vars in 1322 bytes} [Mon Jul 4 08:14:04 2022] POST /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:14:12.888021 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-b3cd74ab-9c1f-430b-a19a-496896836bfc tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:12.888660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-b3cd74ab-9c1f-430b-a19a-496896836bfc tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:12.895744 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b3cd74ab-9c1f-430b-a19a-496896836bfc tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:12.896299 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b3cd74ab-9c1f-430b-a19a-496896836bfc tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:12.897132 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b3cd74ab-9c1f-430b-a19a-496896836bfc tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:12.897558 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-b3cd74ab-9c1f-430b-a19a-496896836bfc tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:13.042136 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-b3cd74ab-9c1f-430b-a19a-496896836bfc tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:13.051153 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-b3cd74ab-9c1f-430b-a19a-496896836bfc tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1593 microversion: 2.1 time: 0.167008 Jul 04 08:14:13.051760 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 542/1157] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:12 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1593 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:14.879223 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:14:14.888432 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-8aae8028-4300-4d84-9afa-cc864cfaae63 req-1185e226-8db5-4db6-8fef-771e85eff5c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd2b4ce-89f3-40e8-9840-487fc646456b", "tag": "d63ec938-97a9-4e67-822a-e96d42a2c118"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:14:14.895613 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:14:14.906793 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-8aae8028-4300-4d84-9afa-cc864cfaae63 req-1185e226-8db5-4db6-8fef-771e85eff5c5 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:14.907273 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-8aae8028-4300-4d84-9afa-cc864cfaae63 req-1185e226-8db5-4db6-8fef-771e85eff5c5 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:14.910714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:14:14.926148 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-8aae8028-4300-4d84-9afa-cc864cfaae63 req-1185e226-8db5-4db6-8fef-771e85eff5c5 service nova] Creating event network-changed:d63ec938-97a9-4e67-822a-e96d42a2c118 for instance 7bd2b4ce-89f3-40e8-9840-487fc646456b on hv-cinder-79760 Jul 04 08:14:14.931655 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-8aae8028-4300-4d84-9afa-cc864cfaae63 req-1185e226-8db5-4db6-8fef-771e85eff5c5 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055424 Jul 04 08:14:14.932275 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 616/1158] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:14:16.460014 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ab814de5-ce8b-4b65-8dea-5bd288aedc98 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1102229131"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:14:16.460690 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ab814de5-ce8b-4b65-8dea-5bd288aedc98 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:16.463238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:14:16.469102 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab814de5-ce8b-4b65-8dea-5bd288aedc98 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:16.469743 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab814de5-ce8b-4b65-8dea-5bd288aedc98 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:16.471008 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab814de5-ce8b-4b65-8dea-5bd288aedc98 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:16.471458 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab814de5-ce8b-4b65-8dea-5bd288aedc98 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:16.474903 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=65 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:14:16.622739 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.network.security_group_api [None req-ab814de5-ce8b-4b65-8dea-5bd288aedc98 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Adding security group ccb4d106-b2ad-47e4-bb23-0c3d8d50551b to port d63ec938-97a9-4e67-822a-e96d42a2c118 Jul 04 08:14:17.052656 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ab814de5-ce8b-4b65-8dea-5bd288aedc98 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "POST /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/action" status: 202 len: 0 microversion: 2.1 time: 0.596555 Jul 04 08:14:17.061118 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 543/1159] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:14:16 2022] POST /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:14:17.067163 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-cce829a6-0b5d-4ca0-ab97-ac657176bc96 req-1a140f9d-0c7f-45ce-b8de-2f8b33f65a64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd2b4ce-89f3-40e8-9840-487fc646456b", "tag": "d63ec938-97a9-4e67-822a-e96d42a2c118"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:14:17.069860 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-72597269-84bc-485b-a36f-f5dc3f1bd684 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:17.071123 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-72597269-84bc-485b-a36f-f5dc3f1bd684 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:17.086819 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-cce829a6-0b5d-4ca0-ab97-ac657176bc96 req-1a140f9d-0c7f-45ce-b8de-2f8b33f65a64 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:17.087354 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-cce829a6-0b5d-4ca0-ab97-ac657176bc96 req-1a140f9d-0c7f-45ce-b8de-2f8b33f65a64 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:17.097199 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-72597269-84bc-485b-a36f-f5dc3f1bd684 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:17.098329 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-72597269-84bc-485b-a36f-f5dc3f1bd684 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:17.100067 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-72597269-84bc-485b-a36f-f5dc3f1bd684 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:17.100849 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-72597269-84bc-485b-a36f-f5dc3f1bd684 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:17.107946 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-cce829a6-0b5d-4ca0-ab97-ac657176bc96 req-1a140f9d-0c7f-45ce-b8de-2f8b33f65a64 service nova] Creating event network-changed:d63ec938-97a9-4e67-822a-e96d42a2c118 for instance 7bd2b4ce-89f3-40e8-9840-487fc646456b on hv-cinder-79760 Jul 04 08:14:17.118093 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-cce829a6-0b5d-4ca0-ab97-ac657176bc96 req-1a140f9d-0c7f-45ce-b8de-2f8b33f65a64 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055121 Jul 04 08:14:17.118953 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 544/1160] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:14:17.361714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-72597269-84bc-485b-a36f-f5dc3f1bd684 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:17.372638 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-72597269-84bc-485b-a36f-f5dc3f1bd684 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1758 microversion: 2.1 time: 0.313405 Jul 04 08:14:17.373862 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 617/1161] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:17 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1758 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:39.890274 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=3 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:14:39.891085 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=5 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:14:39.896044 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-eb6def62-a42a-4725-ac2c-11dfe8357bb2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:14:39.897075 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-eb6def62-a42a-4725-ac2c-11dfe8357bb2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:39.904942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb6def62-a42a-4725-ac2c-11dfe8357bb2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:39.905390 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb6def62-a42a-4725-ac2c-11dfe8357bb2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:39.906591 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb6def62-a42a-4725-ac2c-11dfe8357bb2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:39.907024 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-eb6def62-a42a-4725-ac2c-11dfe8357bb2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:39.990305 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-eb6def62-a42a-4725-ac2c-11dfe8357bb2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "POST /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/action" status: 202 len: 0 microversion: 2.1 time: 0.101595 Jul 04 08:14:39.991200 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 545/1162] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:14:39 2022] POST /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:14:40.003403 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c9d8dd48-f502-4d63-8859-3b5aaa685c3e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:40.005240 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c9d8dd48-f502-4d63-8859-3b5aaa685c3e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:40.007787 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:14:40.008684 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=7 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:14:40.015915 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9d8dd48-f502-4d63-8859-3b5aaa685c3e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:40.016550 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9d8dd48-f502-4d63-8859-3b5aaa685c3e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:40.017656 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9d8dd48-f502-4d63-8859-3b5aaa685c3e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:40.018448 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c9d8dd48-f502-4d63-8859-3b5aaa685c3e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:40.177040 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c9d8dd48-f502-4d63-8859-3b5aaa685c3e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:40.188983 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c9d8dd48-f502-4d63-8859-3b5aaa685c3e tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1750 microversion: 2.1 time: 0.193200 Jul 04 08:14:40.189832 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 618/1163] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:39 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1750 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:41.209190 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8eb867c9-8f33-4dc8-a9b2-6158919d93a3 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:41.209925 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8eb867c9-8f33-4dc8-a9b2-6158919d93a3 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:41.217052 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8eb867c9-8f33-4dc8-a9b2-6158919d93a3 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:41.217529 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8eb867c9-8f33-4dc8-a9b2-6158919d93a3 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:41.218334 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8eb867c9-8f33-4dc8-a9b2-6158919d93a3 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:41.218765 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8eb867c9-8f33-4dc8-a9b2-6158919d93a3 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:41.385323 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8eb867c9-8f33-4dc8-a9b2-6158919d93a3 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:41.395465 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8eb867c9-8f33-4dc8-a9b2-6158919d93a3 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.190768 Jul 04 08:14:41.396322 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 546/1164] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:41 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:42.420036 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7b657e60-be40-4652-886d-30160b637431 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:42.421053 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7b657e60-be40-4652-886d-30160b637431 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:42.433171 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7b657e60-be40-4652-886d-30160b637431 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:42.433992 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7b657e60-be40-4652-886d-30160b637431 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:42.435182 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7b657e60-be40-4652-886d-30160b637431 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:42.435910 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7b657e60-be40-4652-886d-30160b637431 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:42.598154 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7b657e60-be40-4652-886d-30160b637431 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:42.608671 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7b657e60-be40-4652-886d-30160b637431 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.196307 Jul 04 08:14:42.609294 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 619/1165] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:42 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:43.628070 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-51e85ed6-5385-4375-9d02-5576996ef464 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:43.628733 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-51e85ed6-5385-4375-9d02-5576996ef464 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:43.635944 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-51e85ed6-5385-4375-9d02-5576996ef464 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:43.636387 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-51e85ed6-5385-4375-9d02-5576996ef464 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:43.637164 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-51e85ed6-5385-4375-9d02-5576996ef464 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:43.637592 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-51e85ed6-5385-4375-9d02-5576996ef464 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:43.789951 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-51e85ed6-5385-4375-9d02-5576996ef464 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:43.798634 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-51e85ed6-5385-4375-9d02-5576996ef464 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.174850 Jul 04 08:14:43.799238 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 547/1166] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:43 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:44.817220 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-70a88401-a41d-4d04-9eaf-fa3ef265bc45 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:44.818444 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-70a88401-a41d-4d04-9eaf-fa3ef265bc45 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:44.826304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70a88401-a41d-4d04-9eaf-fa3ef265bc45 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:44.826748 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70a88401-a41d-4d04-9eaf-fa3ef265bc45 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:44.827516 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70a88401-a41d-4d04-9eaf-fa3ef265bc45 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:44.827969 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70a88401-a41d-4d04-9eaf-fa3ef265bc45 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:44.980735 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-70a88401-a41d-4d04-9eaf-fa3ef265bc45 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:44.989233 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-70a88401-a41d-4d04-9eaf-fa3ef265bc45 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.176406 Jul 04 08:14:44.989865 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 620/1167] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:44 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:46.009383 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f920bbce-ddd4-4237-8773-1b862ebdfad5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:46.010062 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f920bbce-ddd4-4237-8773-1b862ebdfad5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:46.017326 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f920bbce-ddd4-4237-8773-1b862ebdfad5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:46.017808 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f920bbce-ddd4-4237-8773-1b862ebdfad5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:46.018610 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f920bbce-ddd4-4237-8773-1b862ebdfad5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:46.019049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f920bbce-ddd4-4237-8773-1b862ebdfad5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:46.172879 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-f920bbce-ddd4-4237-8773-1b862ebdfad5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:46.184408 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f920bbce-ddd4-4237-8773-1b862ebdfad5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.179355 Jul 04 08:14:46.185162 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 548/1168] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:46 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:47.206267 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cca8ad4a-d113-4316-8f09-4eaf9d6f4008 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:47.206868 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cca8ad4a-d113-4316-8f09-4eaf9d6f4008 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:47.214609 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cca8ad4a-d113-4316-8f09-4eaf9d6f4008 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:47.215054 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cca8ad4a-d113-4316-8f09-4eaf9d6f4008 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:47.215897 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cca8ad4a-d113-4316-8f09-4eaf9d6f4008 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:47.216344 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cca8ad4a-d113-4316-8f09-4eaf9d6f4008 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:47.401568 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cca8ad4a-d113-4316-8f09-4eaf9d6f4008 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:47.410737 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cca8ad4a-d113-4316-8f09-4eaf9d6f4008 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.208236 Jul 04 08:14:47.411740 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 621/1169] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:47 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:48.429420 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8245b10b-20c9-4e5f-88d9-f70cf771fb69 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:48.430150 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8245b10b-20c9-4e5f-88d9-f70cf771fb69 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:48.437660 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8245b10b-20c9-4e5f-88d9-f70cf771fb69 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:48.438123 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8245b10b-20c9-4e5f-88d9-f70cf771fb69 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:48.438903 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8245b10b-20c9-4e5f-88d9-f70cf771fb69 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:48.439334 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8245b10b-20c9-4e5f-88d9-f70cf771fb69 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:48.599303 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8245b10b-20c9-4e5f-88d9-f70cf771fb69 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:48.607652 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8245b10b-20c9-4e5f-88d9-f70cf771fb69 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.182686 Jul 04 08:14:48.608225 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 549/1170] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:48 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:49.626300 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fdff6326-3919-4fb3-9a5b-ccc453d9a6d2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:49.626932 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fdff6326-3919-4fb3-9a5b-ccc453d9a6d2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:49.634677 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fdff6326-3919-4fb3-9a5b-ccc453d9a6d2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:49.635119 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fdff6326-3919-4fb3-9a5b-ccc453d9a6d2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:49.635890 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fdff6326-3919-4fb3-9a5b-ccc453d9a6d2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:49.636301 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fdff6326-3919-4fb3-9a5b-ccc453d9a6d2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:49.792583 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fdff6326-3919-4fb3-9a5b-ccc453d9a6d2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:49.801035 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fdff6326-3919-4fb3-9a5b-ccc453d9a6d2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.178880 Jul 04 08:14:49.801615 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 622/1171] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:49 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:50.824173 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-1aa5f82c-6fae-4b93-af55-6136b14d8b9a tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:50.825350 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-1aa5f82c-6fae-4b93-af55-6136b14d8b9a tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:50.838942 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1aa5f82c-6fae-4b93-af55-6136b14d8b9a tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:50.840447 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1aa5f82c-6fae-4b93-af55-6136b14d8b9a tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:50.841890 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1aa5f82c-6fae-4b93-af55-6136b14d8b9a tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:50.842671 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-1aa5f82c-6fae-4b93-af55-6136b14d8b9a tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:51.013301 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-1aa5f82c-6fae-4b93-af55-6136b14d8b9a tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:51.024049 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-1aa5f82c-6fae-4b93-af55-6136b14d8b9a tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.207564 Jul 04 08:14:51.024968 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 550/1172] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:50 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:51.269844 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ff298361-01db-4d5b-a39d-a985043b558a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:51.270408 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ff298361-01db-4d5b-a39d-a985043b558a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:51.277359 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ff298361-01db-4d5b-a39d-a985043b558a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:51.277841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ff298361-01db-4d5b-a39d-a985043b558a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:51.278679 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ff298361-01db-4d5b-a39d-a985043b558a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:51.279035 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ff298361-01db-4d5b-a39d-a985043b558a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:51.308135 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ff298361-01db-4d5b-a39d-a985043b558a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:14:51.346657 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-76632360-7dac-4db7-9c07-fe15855aa447 req-a794e6fa-9ff8-4d7d-8da8-5725261cd671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3357a4e-9590-4c32-87ac-85b781b6c9dc", "tag": "1d25461c-f06e-4eea-b273-0810acd24dd5"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:14:51.357777 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-76632360-7dac-4db7-9c07-fe15855aa447 req-a794e6fa-9ff8-4d7d-8da8-5725261cd671 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:51.358529 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-76632360-7dac-4db7-9c07-fe15855aa447 req-a794e6fa-9ff8-4d7d-8da8-5725261cd671 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:51.371882 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-76632360-7dac-4db7-9c07-fe15855aa447 req-a794e6fa-9ff8-4d7d-8da8-5725261cd671 service nova] Creating event network-changed:1d25461c-f06e-4eea-b273-0810acd24dd5 for instance a3357a4e-9590-4c32-87ac-85b781b6c9dc on hv-cinder-79760 Jul 04 08:14:51.378039 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-76632360-7dac-4db7-9c07-fe15855aa447 req-a794e6fa-9ff8-4d7d-8da8-5725261cd671 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109599 Jul 04 08:14:51.378915 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 551/1173] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:14:51.403794 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ff298361-01db-4d5b-a39d-a985043b558a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "DELETE /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 204 len: 0 microversion: 2.1 time: 0.137375 Jul 04 08:14:51.404713 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 623/1174] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:14:51 2022] DELETE /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:14:51.414336 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-59ac06e6-33c2-487a-9ba6-3fbe74a78da3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:51.415015 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-59ac06e6-33c2-487a-9ba6-3fbe74a78da3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:51.422120 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-59ac06e6-33c2-487a-9ba6-3fbe74a78da3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:51.422834 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-59ac06e6-33c2-487a-9ba6-3fbe74a78da3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:51.423772 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-59ac06e6-33c2-487a-9ba6-3fbe74a78da3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:51.424351 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-59ac06e6-33c2-487a-9ba6-3fbe74a78da3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:51.573058 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-59ac06e6-33c2-487a-9ba6-3fbe74a78da3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:51.579693 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-59ac06e6-33c2-487a-9ba6-3fbe74a78da3 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1579 microversion: 2.1 time: 0.169845 Jul 04 08:14:51.580287 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 552/1175] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:51 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:52.042964 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e8543540-2715-4d51-82ff-85ed2f46afa8 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:52.043651 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e8543540-2715-4d51-82ff-85ed2f46afa8 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:52.050294 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e8543540-2715-4d51-82ff-85ed2f46afa8 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:52.050739 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e8543540-2715-4d51-82ff-85ed2f46afa8 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:52.051556 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e8543540-2715-4d51-82ff-85ed2f46afa8 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:52.051979 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e8543540-2715-4d51-82ff-85ed2f46afa8 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:52.233909 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e8543540-2715-4d51-82ff-85ed2f46afa8 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:52.243062 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e8543540-2715-4d51-82ff-85ed2f46afa8 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1755 microversion: 2.1 time: 0.204424 Jul 04 08:14:52.243644 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 624/1176] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:52 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1755 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:52.601162 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-577600db-f432-4ce5-ace2-122de6a920a6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:52.601904 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-577600db-f432-4ce5-ace2-122de6a920a6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:52.609008 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-577600db-f432-4ce5-ace2-122de6a920a6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:52.609457 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-577600db-f432-4ce5-ace2-122de6a920a6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:52.610258 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-577600db-f432-4ce5-ace2-122de6a920a6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:52.610732 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-577600db-f432-4ce5-ace2-122de6a920a6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:52.759873 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-577600db-f432-4ce5-ace2-122de6a920a6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:52.767686 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-577600db-f432-4ce5-ace2-122de6a920a6 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1579 microversion: 2.1 time: 0.172382 Jul 04 08:14:52.768264 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 553/1177] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:52 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1579 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:53.265758 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4e2ac67d-0882-4755-b5a6-164c6a013b00 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:53.266885 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4e2ac67d-0882-4755-b5a6-164c6a013b00 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:53.278303 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4e2ac67d-0882-4755-b5a6-164c6a013b00 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:53.279042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4e2ac67d-0882-4755-b5a6-164c6a013b00 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:53.280322 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4e2ac67d-0882-4755-b5a6-164c6a013b00 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:53.281086 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4e2ac67d-0882-4755-b5a6-164c6a013b00 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:53.450271 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4e2ac67d-0882-4755-b5a6-164c6a013b00 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:53.461349 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4e2ac67d-0882-4755-b5a6-164c6a013b00 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1758 microversion: 2.1 time: 0.202383 Jul 04 08:14:53.461981 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 625/1178] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:53 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1758 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:53.787379 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-23af95ee-4878-445e-a436-acfc8a3b2e3b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:53.788045 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-23af95ee-4878-445e-a436-acfc8a3b2e3b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:53.795282 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-23af95ee-4878-445e-a436-acfc8a3b2e3b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:53.795488 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-23af95ee-4878-445e-a436-acfc8a3b2e3b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:53.796302 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-23af95ee-4878-445e-a436-acfc8a3b2e3b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:53.796743 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-23af95ee-4878-445e-a436-acfc8a3b2e3b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:54.417756 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-23af95ee-4878-445e-a436-acfc8a3b2e3b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:54.426185 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-23af95ee-4878-445e-a436-acfc8a3b2e3b tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1579 microversion: 2.1 time: 0.643305 Jul 04 08:14:54.426748 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 554/1179] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:53 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1579 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:54.948917 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-c11c4db2-cbb6-4bb5-ac25-7f6669220e12 req-c76bfb7c-f9f8-4fbe-8bb6-08e59f5c8aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3357a4e-9590-4c32-87ac-85b781b6c9dc", "name": "network-vif-deleted", "tag": "1d25461c-f06e-4eea-b273-0810acd24dd5"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:14:54.957381 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-c11c4db2-cbb6-4bb5-ac25-7f6669220e12 req-c76bfb7c-f9f8-4fbe-8bb6-08e59f5c8aa6 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:54.957854 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-c11c4db2-cbb6-4bb5-ac25-7f6669220e12 req-c76bfb7c-f9f8-4fbe-8bb6-08e59f5c8aa6 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:54.971244 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-c11c4db2-cbb6-4bb5-ac25-7f6669220e12 req-c76bfb7c-f9f8-4fbe-8bb6-08e59f5c8aa6 service nova] Creating event network-vif-deleted:1d25461c-f06e-4eea-b273-0810acd24dd5 for instance a3357a4e-9590-4c32-87ac-85b781b6c9dc on hv-cinder-79760 Jul 04 08:14:54.980703 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-c11c4db2-cbb6-4bb5-ac25-7f6669220e12 req-c76bfb7c-f9f8-4fbe-8bb6-08e59f5c8aa6 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116942 Jul 04 08:14:54.981310 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 626/1180] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:14:55.445509 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:55.446144 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:55.453968 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:55.454419 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:55.455187 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:55.455622 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:55.490507 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:55.490920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:55.491398 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.objects.instance [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lazy-loading 'fault' on Instance uuid a3357a4e-9590-4c32-87ac-85b781b6c9dc {{(pid=117870) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:14:55.535467 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:14:55.543583 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-892035a9-79f6-47b6-afe0-980aeadbde92 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 200 len: 1231 microversion: 2.1 time: 0.102206 Jul 04 08:14:55.544163 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 555/1181] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:55 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:14:56.563029 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:56.563714 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: a3357a4e-9590-4c32-87ac-85b781b6c9dc] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:56.570935 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:56.571380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:56.572156 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:56.572842 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:56.586997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] HTTP exception thrown: Instance a3357a4e-9590-4c32-87ac-85b781b6c9dc could not be found. Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Request method failure captured: Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc HTTP/1.1 Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp-JFn-CxKVQny0eU9lT-0Jn7160KdyxiV8v6lv2916EujzcoOEFGbIgjM9-DRpubHQGJQgsaYQzrvffvdBrPBraI27sMur0-T6YKZPZ00jgj3Sc5tgOHyWpimZJKmU4C7UpMnnfH3MZM23bZsA69JXs8D0IsHA30Ru7dZTu-GeSsEw Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:14:56.589042 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1b0f9c7bc044f6c802c8cd34da4eb0e", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: fa28f0e0b3b0488faf7db7bf7dc3854b Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance a3357a4e-9590-4c32-87ac-85b781b6c9dc could not be found. Jul 04 08:14:56.590693 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': 'a3357a4e-9590-4c32-87ac-85b781b6c9dc'} Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3357a4e-9590-4c32-87ac-85b781b6c9dc could not be found. Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:14:56.591555 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3357a4e-9590-4c32-87ac-85b781b6c9dc could not be found. Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3357a4e-9590-4c32-87ac-85b781b6c9dc could not be found. Jul 04 08:14:56.593204 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:14:56.594708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Returning 404 to user: Instance a3357a4e-9590-4c32-87ac-85b781b6c9dc could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:14:56.594708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-336207f1-a91d-4d5e-9611-5060c14d422c tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc" status: 404 len: 111 microversion: 2.1 time: 0.032507 Jul 04 08:14:56.594708 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 627/1182] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:56 2022] GET /compute/v2.1/servers/a3357a4e-9590-4c32-87ac-85b781b6c9dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:14:59.782806 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-ab0693d4-0a4b-4a74-aa7a-2ce21f9e4649 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:59.783504 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ab0693d4-0a4b-4a74-aa7a-2ce21f9e4649 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:59.784669 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-4358df0d-eff3-4e29-a65b-feb01dcffcf6 req-a7e1d615-e28e-449a-afe8-00c66658afc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4231e66-b993-47b6-9da6-869b1258d7ed", "tag": "65fb0420-dfb3-4fe8-b366-98253c495984"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:14:59.790873 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab0693d4-0a4b-4a74-aa7a-2ce21f9e4649 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:59.791318 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab0693d4-0a4b-4a74-aa7a-2ce21f9e4649 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:59.792089 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab0693d4-0a4b-4a74-aa7a-2ce21f9e4649 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:59.792516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-ab0693d4-0a4b-4a74-aa7a-2ce21f9e4649 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:59.793597 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-4358df0d-eff3-4e29-a65b-feb01dcffcf6 req-a7e1d615-e28e-449a-afe8-00c66658afc2 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:59.794077 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-4358df0d-eff3-4e29-a65b-feb01dcffcf6 req-a7e1d615-e28e-449a-afe8-00c66658afc2 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:59.805586 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-4358df0d-eff3-4e29-a65b-feb01dcffcf6 req-a7e1d615-e28e-449a-afe8-00c66658afc2 service nova] Creating event network-changed:65fb0420-dfb3-4fe8-b366-98253c495984 for instance c4231e66-b993-47b6-9da6-869b1258d7ed on hv-cinder-79760 Jul 04 08:14:59.810637 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-4358df0d-eff3-4e29-a65b-feb01dcffcf6 req-a7e1d615-e28e-449a-afe8-00c66658afc2 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029594 Jul 04 08:14:59.811482 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 628/1183] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 04 08:14:59.819571 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-ab0693d4-0a4b-4a74-aa7a-2ce21f9e4649 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:14:59.910415 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-ab0693d4-0a4b-4a74-aa7a-2ce21f9e4649 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "DELETE /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 204 len: 0 microversion: 2.1 time: 0.131939 Jul 04 08:14:59.911197 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 556/1184] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:14:59 2022] DELETE /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:14:59.921438 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d407538a-1eb0-4ac0-8e14-b79a0b2962aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:14:59.922151 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d407538a-1eb0-4ac0-8e14-b79a0b2962aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:14:59.929446 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d407538a-1eb0-4ac0-8e14-b79a0b2962aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:59.930172 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d407538a-1eb0-4ac0-8e14-b79a0b2962aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:14:59.931024 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d407538a-1eb0-4ac0-8e14-b79a0b2962aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:14:59.931676 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d407538a-1eb0-4ac0-8e14-b79a0b2962aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:00.085888 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d407538a-1eb0-4ac0-8e14-b79a0b2962aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:15:00.093802 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d407538a-1eb0-4ac0-8e14-b79a0b2962aa tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1577 microversion: 2.1 time: 0.176610 Jul 04 08:15:00.094393 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 629/1185] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:14:59 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 04 08:15:01.113378 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-8476b5d8-8f3a-42c5-a6ff-72e42c3e5bbe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:01.114110 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-8476b5d8-8f3a-42c5-a6ff-72e42c3e5bbe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:01.121529 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8476b5d8-8f3a-42c5-a6ff-72e42c3e5bbe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:01.122089 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8476b5d8-8f3a-42c5-a6ff-72e42c3e5bbe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:01.123256 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8476b5d8-8f3a-42c5-a6ff-72e42c3e5bbe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:01.123955 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-8476b5d8-8f3a-42c5-a6ff-72e42c3e5bbe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:01.325850 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-8476b5d8-8f3a-42c5-a6ff-72e42c3e5bbe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:15:01.336950 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-8476b5d8-8f3a-42c5-a6ff-72e42c3e5bbe tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1577 microversion: 2.1 time: 0.228712 Jul 04 08:15:01.337568 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 557/1186] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:15:01 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1577 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:15:02.265208 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-4a693c20-b8d7-4312-bd9a-e1f2e0102a25 req-4eb8647d-0976-495d-91e3-d60bcbc7fdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4231e66-b993-47b6-9da6-869b1258d7ed", "name": "network-vif-deleted", "tag": "65fb0420-dfb3-4fe8-b366-98253c495984"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:15:02.274125 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-4a693c20-b8d7-4312-bd9a-e1f2e0102a25 req-4eb8647d-0976-495d-91e3-d60bcbc7fdde service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:02.274561 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-4a693c20-b8d7-4312-bd9a-e1f2e0102a25 req-4eb8647d-0976-495d-91e3-d60bcbc7fdde service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:02.286139 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-4a693c20-b8d7-4312-bd9a-e1f2e0102a25 req-4eb8647d-0976-495d-91e3-d60bcbc7fdde service nova] Creating event network-vif-deleted:65fb0420-dfb3-4fe8-b366-98253c495984 for instance c4231e66-b993-47b6-9da6-869b1258d7ed on hv-cinder-79760 Jul 04 08:15:02.290774 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-4a693c20-b8d7-4312-bd9a-e1f2e0102a25 req-4eb8647d-0976-495d-91e3-d60bcbc7fdde service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029256 Jul 04 08:15:02.291347 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 630/1187] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:15:02.355254 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-4523d9b7-74a0-442f-8dc1-582379144979 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:02.355943 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-4523d9b7-74a0-442f-8dc1-582379144979 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:02.363433 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4523d9b7-74a0-442f-8dc1-582379144979 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:02.363830 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4523d9b7-74a0-442f-8dc1-582379144979 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:02.364579 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4523d9b7-74a0-442f-8dc1-582379144979 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:02.365013 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-4523d9b7-74a0-442f-8dc1-582379144979 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:02.429906 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-4523d9b7-74a0-442f-8dc1-582379144979 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa28f0e0b3b0488faf7db7bf7dc3854b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1b0f9c7bc044f6c802c8cd34da4eb0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:15:02.441141 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-4523d9b7-74a0-442f-8dc1-582379144979 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 200 len: 1225 microversion: 2.1 time: 0.089661 Jul 04 08:15:02.441919 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 558/1188] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:15:02 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:15:03.464056 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:03.464735 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: c4231e66-b993-47b6-9da6-869b1258d7ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:03.471746 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:03.472187 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:03.472946 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:03.473374 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:03.490643 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] HTTP exception thrown: Instance c4231e66-b993-47b6-9da6-869b1258d7ed could not be found. Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Request method failure captured: Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed HTTP/1.1 Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp-JFn-CxKVQny0eU9lT-0Jn7160KdyxiV8v6lv2916EujzcoOEFGbIgjM9-DRpubHQGJQgsaYQzrvffvdBrPBraI27sMur0-T6YKZPZ00jgj3Sc5tgOHyWpimZJKmU4C7UpMnnfH3MZM23bZsA69JXs8D0IsHA30Ru7dZTu-GeSsEw Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:15:03.492341 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1b0f9c7bc044f6c802c8cd34da4eb0e", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: fa28f0e0b3b0488faf7db7bf7dc3854b Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance c4231e66-b993-47b6-9da6-869b1258d7ed could not be found. Jul 04 08:15:03.493807 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': 'c4231e66-b993-47b6-9da6-869b1258d7ed'} Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4231e66-b993-47b6-9da6-869b1258d7ed could not be found. Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:15:03.494663 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4231e66-b993-47b6-9da6-869b1258d7ed could not be found. Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4231e66-b993-47b6-9da6-869b1258d7ed could not be found. Jul 04 08:15:03.496213 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:03.498261 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Returning 404 to user: Instance c4231e66-b993-47b6-9da6-869b1258d7ed could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:15:03.498261 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-dd9629e2-d31e-4586-a47a-470563508d9e tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed" status: 404 len: 111 microversion: 2.1 time: 0.034640 Jul 04 08:15:03.498261 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 631/1189] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:15:03 2022] GET /compute/v2.1/servers/c4231e66-b993-47b6-9da6-869b1258d7ed => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 04 08:15:03.982889 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:03.983759 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:03.992580 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:03.993023 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:03.993822 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:03.994244 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:03.998401 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:15:04.009712 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.wsgi [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] HTTP exception thrown: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Request method failure captured: Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: request: DELETE /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 HTTP/1.1 Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept: application/json Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Accept-Encoding: identity Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Connection: close Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Length: 0 Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Content-Type: application/json Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Host: 10.222.0.43 Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Openstack-System-Scope: None Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: User-Agent: python-urllib3/1.26.9 Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Auth-Token: gAAAAABiwp-JFn-CxKVQny0eU9lT-0Jn7160KdyxiV8v6lv2916EujzcoOEFGbIgjM9-DRpubHQGJQgsaYQzrvffvdBrPBraI27sMur0-T6YKZPZ00jgj3Sc5tgOHyWpimZJKmU4C7UpMnnfH3MZM23bZsA69JXs8D0IsHA30Ru7dZTu-GeSsEw Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Id: None Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Domain-Name: None Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Identity-Status: Confirmed Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Is-Admin-Project: True Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Id: default Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Domain-Name: Default Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Project-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Role: member,reader Jul 04 08:15:04.011528 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Roles: member,reader Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1b0f9c7bc044f6c802c8cd34da4eb0e", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-Tenant-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Id: default Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Domain-Name: Default Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Id: fa28f0e0b3b0488faf7db7bf7dc3854b Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: X-User-Name: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: method: > Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: exception: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.013255 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: action_args: {'id': '2cf097eb-a2e5-4ce3-b0d9-1104988fe661'} Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:15:04.014218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.015872 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.017788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Returning 404 to user: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. {{(pid=117870) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:15:04.017788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6eeca8bc-e717-4e26-95a0-cc15f5e2ef80 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "DELETE /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 404 len: 111 microversion: 2.1 time: 0.036169 Jul 04 08:15:04.017788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 559/1190] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:15:03 2022] DELETE /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:15:04.021784 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:04.022391 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [instance: 2cf097eb-a2e5-4ce3-b0d9-1104988fe661] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:04.028791 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:04.029228 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:04.029996 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:04.030417 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:04.044741 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] HTTP exception thrown: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Request method failure captured: Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 HTTP/1.1 Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwp-JFn-CxKVQny0eU9lT-0Jn7160KdyxiV8v6lv2916EujzcoOEFGbIgjM9-DRpubHQGJQgsaYQzrvffvdBrPBraI27sMur0-T6YKZPZ00jgj3Sc5tgOHyWpimZJKmU4C7UpMnnfH3MZM23bZsA69JXs8D0IsHA30Ru7dZTu-GeSsEw Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:15:04.046287 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/d1b0f9c7bc044f6c802c8cd34da4eb0e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_d1b0f9c7bc044f6c802c8cd34da4eb0e", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: d1b0f9c7bc044f6c802c8cd34da4eb0e Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1891079653 Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: fa28f0e0b3b0488faf7db7bf7dc3854b Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-TestVolumeBootPattern-1891079653-project Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.048102 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '2cf097eb-a2e5-4ce3-b0d9-1104988fe661'} Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:15:04.049239 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. Jul 04 08:15:04.050912 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:04.052365 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Returning 404 to user: Instance 2cf097eb-a2e5-4ce3-b0d9-1104988fe661 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:15:04.052365 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-32bafd7e-9d79-47a5-82c8-fd41c3427565 tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661" status: 404 len: 111 microversion: 2.1 time: 0.029740 Jul 04 08:15:04.052365 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 632/1191] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:15:04 2022] GET /compute/v2.1/servers/2cf097eb-a2e5-4ce3-b0d9-1104988fe661 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:15:05.364992 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-2248bf94-a9c6-4173-8a9b-c5fbfb6cee8a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] Calling method '.version_select at 0x7f05e553ef70>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:05.368516 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2248bf94-a9c6-4173-8a9b-c5fbfb6cee8a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [0ffed0c2-106b-4a2c-8ac1-11ad52ab38e3] AMQP server on 10.222.0.43:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 04 08:15:06.376734 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO oslo.messaging._drivers.impl_rabbit [None req-2248bf94-a9c6-4173-8a9b-c5fbfb6cee8a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] [0ffed0c2-106b-4a2c-8ac1-11ad52ab38e3] Reconnected to AMQP server on 10.222.0.43:5672 via [amqp] client with port 57676. Jul 04 08:15:06.401435 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-2248bf94-a9c6-4173-8a9b-c5fbfb6cee8a tempest-TestVolumeBootPattern-1891079653 tempest-TestVolumeBootPattern-1891079653-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1698566224" status: 202 len: 0 microversion: 2.1 time: 1.041937 Jul 04 08:15:06.402076 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 560/1192] 10.222.0.43 () {58 vars in 1262 bytes} [Mon Jul 4 08:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1698566224 => generated 0 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:15:25.986018 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-147b1987-9443-4597-8069-66728865c505 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1102229131"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:15:25.986774 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-147b1987-9443-4597-8069-66728865c505 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:25.989847 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:15:25.990017 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:15:25.998920 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-147b1987-9443-4597-8069-66728865c505 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:25.999627 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-147b1987-9443-4597-8069-66728865c505 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:26.000443 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-147b1987-9443-4597-8069-66728865c505 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:26.000874 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-147b1987-9443-4597-8069-66728865c505 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:26.154424 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.network.security_group_api [None req-147b1987-9443-4597-8069-66728865c505 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Removing security group ccb4d106-b2ad-47e4-bb23-0c3d8d50551b from port d63ec938-97a9-4e67-822a-e96d42a2c118 Jul 04 08:15:26.577250 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-147b1987-9443-4597-8069-66728865c505 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "POST /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/action" status: 202 len: 0 microversion: 2.1 time: 0.595112 Jul 04 08:15:26.577901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 633/1193] 10.222.0.43 () {60 vars in 1277 bytes} [Mon Jul 4 08:15:25 2022] POST /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:15:26.583532 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG dbcounter [-] [117870] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 04 08:15:26.589171 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-fd4cbde6-19a3-4661-9759-54332bf995d0 req-bf3a1d94-44f1-40bf-a997-1720f08e3592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd2b4ce-89f3-40e8-9840-487fc646456b", "tag": "d63ec938-97a9-4e67-822a-e96d42a2c118"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:15:26.599370 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-fd4cbde6-19a3-4661-9759-54332bf995d0 req-bf3a1d94-44f1-40bf-a997-1720f08e3592 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:26.603216 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-fd4cbde6-19a3-4661-9759-54332bf995d0 req-bf3a1d94-44f1-40bf-a997-1720f08e3592 service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:26.634422 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-fd4cbde6-19a3-4661-9759-54332bf995d0 req-bf3a1d94-44f1-40bf-a997-1720f08e3592 service nova] Creating event network-changed:d63ec938-97a9-4e67-822a-e96d42a2c118 for instance 7bd2b4ce-89f3-40e8-9840-487fc646456b on hv-cinder-79760 Jul 04 08:15:26.639920 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-fd4cbde6-19a3-4661-9759-54332bf995d0 req-bf3a1d94-44f1-40bf-a997-1720f08e3592 service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058428 Jul 04 08:15:26.641020 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 561/1194] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:15:28.007561 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0ad3ba19-a8c7-421b-b30e-1a62f989ce81 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:28.008125 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0ad3ba19-a8c7-421b-b30e-1a62f989ce81 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:28.014425 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0ad3ba19-a8c7-421b-b30e-1a62f989ce81 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:28.014869 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0ad3ba19-a8c7-421b-b30e-1a62f989ce81 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:28.015627 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0ad3ba19-a8c7-421b-b30e-1a62f989ce81 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:28.016055 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0ad3ba19-a8c7-421b-b30e-1a62f989ce81 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:28.099221 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-0ad3ba19-a8c7-421b-b30e-1a62f989ce81 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lazy-loading 'services' on Instance uuid 7bd2b4ce-89f3-40e8-9840-487fc646456b {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 04 08:15:28.175841 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0ad3ba19-a8c7-421b-b30e-1a62f989ce81 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments/070f4e0d-8de7-406b-809d-ad735f5c6f21" status: 202 len: 0 microversion: 2.1 time: 0.173006 Jul 04 08:15:28.176435 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 634/1195] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:15:28 2022] DELETE /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments/070f4e0d-8de7-406b-809d-ad735f5c6f21 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:15:28.188426 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-f2432244-3d43-438b-8135-127d76cb0db5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:28.189935 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-f2432244-3d43-438b-8135-127d76cb0db5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:28.198923 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2432244-3d43-438b-8135-127d76cb0db5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:28.199412 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2432244-3d43-438b-8135-127d76cb0db5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:28.200298 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2432244-3d43-438b-8135-127d76cb0db5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:28.200945 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-f2432244-3d43-438b-8135-127d76cb0db5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:28.245434 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-f2432244-3d43-438b-8135-127d76cb0db5 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063891 Jul 04 08:15:28.246047 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 562/1196] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:15:28 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:15:28.655230 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-76cc936e-52ed-4667-98b0-b25c90fb4ebf req-2d794763-15b5-4e2c-9317-84aea3d6302b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7bd2b4ce-89f3-40e8-9840-487fc646456b", "tag": "d63ec938-97a9-4e67-822a-e96d42a2c118"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:15:28.664227 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-76cc936e-52ed-4667-98b0-b25c90fb4ebf req-2d794763-15b5-4e2c-9317-84aea3d6302b service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:28.664676 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-76cc936e-52ed-4667-98b0-b25c90fb4ebf req-2d794763-15b5-4e2c-9317-84aea3d6302b service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:28.677141 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-76cc936e-52ed-4667-98b0-b25c90fb4ebf req-2d794763-15b5-4e2c-9317-84aea3d6302b service nova] Creating event network-changed:d63ec938-97a9-4e67-822a-e96d42a2c118 for instance 7bd2b4ce-89f3-40e8-9840-487fc646456b on hv-cinder-79760 Jul 04 08:15:28.682478 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-76cc936e-52ed-4667-98b0-b25c90fb4ebf req-2d794763-15b5-4e2c-9317-84aea3d6302b service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031376 Jul 04 08:15:28.683348 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 635/1197] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:15:29.258456 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-0ca1843e-3224-44db-93fa-e808d5d8a193 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:29.259498 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-0ca1843e-3224-44db-93fa-e808d5d8a193 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:29.266778 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ca1843e-3224-44db-93fa-e808d5d8a193 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:29.267427 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ca1843e-3224-44db-93fa-e808d5d8a193 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:29.268333 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ca1843e-3224-44db-93fa-e808d5d8a193 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:29.268789 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-0ca1843e-3224-44db-93fa-e808d5d8a193 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:29.300339 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-0ca1843e-3224-44db-93fa-e808d5d8a193 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045833 Jul 04 08:15:29.300825 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 563/1198] 10.222.0.43 () {58 vars in 1301 bytes} [Mon Jul 4 08:15:29 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 04 08:15:29.311977 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:29.312574 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:29.319351 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:29.319791 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:29.320541 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:29.320964 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:29.402528 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] HTTP exception thrown: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b is not attached to volume 070f4e0d-8de7-406b-809d-ad735f5c6f21 Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Request method failure captured: Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments/070f4e0d-8de7-406b-809d-ad735f5c6f21 HTTP/1.1 Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwqEnzNMDCnN5OlFWXZU5k6IHJPZlT1ix1D6Wy-3ljum03P5ASehRZD-iVZmTXZzjJz6B9LqgH5C62irRLVHhIcVfKtA-lrLb-_MgK2Qge56T5d2unYFvkYMw8A5X0hJrmb24gixZG4MPAhz6OKrH1Nii1QQ094TItTJwebCrT36JfgI Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: fea21868e80c43aa81d1a9d277da4e9d Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-TestMinimumBasicScenario-1524611858 Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:15:29.409997 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea21868e80c43aa81d1a9d277da4e9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea21868e80c43aa81d1a9d277da4e9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fea21868e80c43aa81d1a9d277da4e9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fea21868e80c43aa81d1a9d277da4e9d", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-TestMinimumBasicScenario-1524611858 Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: fea21868e80c43aa81d1a9d277da4e9d Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1524611858 Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-TestMinimumBasicScenario-1524611858-project Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: c11b4c72af804f68ad2bc19e91f11129 Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-TestMinimumBasicScenario-1524611858-project Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:15:29.412485 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b is not attached to volume 070f4e0d-8de7-406b-809d-ad735f5c6f21 Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'server_id': '7bd2b4ce-89f3-40e8-9840-487fc646456b', 'id': '070f4e0d-8de7-406b-809d-ad735f5c6f21'} Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 070f4e0d-8de7-406b-809d-ad735f5c6f21. Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:15:29.413911 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b is not attached to volume 070f4e0d-8de7-406b-809d-ad735f5c6f21 Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b is not attached to volume 070f4e0d-8de7-406b-809d-ad735f5c6f21 Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:29.416457 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Returning 404 to user: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b is not attached to volume 070f4e0d-8de7-406b-809d-ad735f5c6f21 {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:15:29.418653 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-29fb3a94-381e-4b39-9928-0616a71f8568 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments/070f4e0d-8de7-406b-809d-ad735f5c6f21" status: 404 len: 154 microversion: 2.1 time: 0.104527 Jul 04 08:15:29.418653 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 636/1199] 10.222.0.43 () {58 vars in 1415 bytes} [Mon Jul 4 08:15:29 2022] DELETE /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b/os-volume_attachments/070f4e0d-8de7-406b-809d-ad735f5c6f21 => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:15:30.571685 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-6c02d293-a1ea-4a95-9aa4-f7309df82573 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:30.572223 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6c02d293-a1ea-4a95-9aa4-f7309df82573 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:30.579160 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c02d293-a1ea-4a95-9aa4-f7309df82573 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:30.579846 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c02d293-a1ea-4a95-9aa4-f7309df82573 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:30.580588 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c02d293-a1ea-4a95-9aa4-f7309df82573 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:30.581036 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-6c02d293-a1ea-4a95-9aa4-f7309df82573 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:30.606786 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-6c02d293-a1ea-4a95-9aa4-f7309df82573 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Going to try to terminate instance {{(pid=117870) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 04 08:15:30.693098 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-6c02d293-a1ea-4a95-9aa4-f7309df82573 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "DELETE /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 204 len: 0 microversion: 2.1 time: 0.124594 Jul 04 08:15:30.694030 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 564/1200] 10.222.0.43 () {58 vars in 1238 bytes} [Mon Jul 4 08:15:30 2022] DELETE /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 04 08:15:30.703116 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-59f105e0-5a07-4bfe-b563-ef24cee7eaf7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:30.703779 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-59f105e0-5a07-4bfe-b563-ef24cee7eaf7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:30.711348 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-59f105e0-5a07-4bfe-b563-ef24cee7eaf7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:30.711804 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-59f105e0-5a07-4bfe-b563-ef24cee7eaf7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:30.712562 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-59f105e0-5a07-4bfe-b563-ef24cee7eaf7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:30.712991 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-59f105e0-5a07-4bfe-b563-ef24cee7eaf7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:30.849289 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-59f105e0-5a07-4bfe-b563-ef24cee7eaf7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:15:30.857527 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-59f105e0-5a07-4bfe-b563-ef24cee7eaf7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1553 microversion: 2.1 time: 0.158642 Jul 04 08:15:30.858163 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 637/1201] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:15:30 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:15:31.876298 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-94e9645b-4bd8-422f-9732-f9b3d36f5e12 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:31.876958 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.compute.api [None req-94e9645b-4bd8-422f-9732-f9b3d36f5e12 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117870) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:31.884554 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-94e9645b-4bd8-422f-9732-f9b3d36f5e12 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:31.884995 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-94e9645b-4bd8-422f-9732-f9b3d36f5e12 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:31.885791 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-94e9645b-4bd8-422f-9732-f9b3d36f5e12 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:31.886218 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [None req-94e9645b-4bd8-422f-9732-f9b3d36f5e12 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:32.039275 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.policy [None req-94e9645b-4bd8-422f-9732-f9b3d36f5e12 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117870) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:15:32.047718 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-94e9645b-4bd8-422f-9732-f9b3d36f5e12 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1553 microversion: 2.1 time: 0.175754 Jul 04 08:15:32.048297 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 565/1202] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:15:31 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1553 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:15:33.069874 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a4350132-a500-4bb0-997a-29b2557be0b2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:33.069874 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a4350132-a500-4bb0-997a-29b2557be0b2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:33.074235 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a4350132-a500-4bb0-997a-29b2557be0b2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:33.074680 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a4350132-a500-4bb0-997a-29b2557be0b2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:33.075505 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a4350132-a500-4bb0-997a-29b2557be0b2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:33.075949 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a4350132-a500-4bb0-997a-29b2557be0b2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:33.222836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a4350132-a500-4bb0-997a-29b2557be0b2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c11b4c72af804f68ad2bc19e91f11129', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea21868e80c43aa81d1a9d277da4e9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 04 08:15:33.230905 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a4350132-a500-4bb0-997a-29b2557be0b2 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 200 len: 1553 microversion: 2.1 time: 0.169573 Jul 04 08:15:33.231467 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 638/1203] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:15:33 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 04 08:15:33.602420 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [req-1334e0d7-3702-425d-935d-0307d551efa4 req-b755e7f2-8c1d-4e39-9c42-0ec4507b728f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7bd2b4ce-89f3-40e8-9840-487fc646456b", "name": "network-vif-deleted", "tag": "d63ec938-97a9-4e67-822a-e96d42a2c118"}]} {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 04 08:15:33.611543 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1334e0d7-3702-425d-935d-0307d551efa4 req-b755e7f2-8c1d-4e39-9c42-0ec4507b728f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:33.612017 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG oslo_concurrency.lockutils [req-1334e0d7-3702-425d-935d-0307d551efa4 req-b755e7f2-8c1d-4e39-9c42-0ec4507b728f service nova] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117870) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:33.623960 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.compute.server_external_events [req-1334e0d7-3702-425d-935d-0307d551efa4 req-b755e7f2-8c1d-4e39-9c42-0ec4507b728f service nova] Creating event network-vif-deleted:d63ec938-97a9-4e67-822a-e96d42a2c118 for instance 7bd2b4ce-89f3-40e8-9840-487fc646456b on hv-cinder-79760 Jul 04 08:15:33.629065 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [req-1334e0d7-3702-425d-935d-0307d551efa4 req-b755e7f2-8c1d-4e39-9c42-0ec4507b728f service nova] 10.222.0.43 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030428 Jul 04 08:15:33.629670 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 566/1204] 10.222.0.43 () {64 vars in 1317 bytes} [Mon Jul 4 08:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 04 08:15:34.252299 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:34.253339 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] [instance: 7bd2b4ce-89f3-40e8-9840-487fc646456b] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 04 08:15:34.261144 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:34.261594 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:34.262407 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 04 08:15:34.262836 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Lock "38170aea-987e-4b58-8314-95240e7a51a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 04 08:15:34.280951 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] HTTP exception thrown: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b could not be found. Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Request method failure captured: Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b HTTP/1.1 Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Connection: close Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Host: 10.222.0.43 Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABiwqEnzNMDCnN5OlFWXZU5k6IHJPZlT1ix1D6Wy-3ljum03P5ASehRZD-iVZmTXZzjJz6B9LqgH5C62irRLVHhIcVfKtA-lrLb-_MgK2Qge56T5d2unYFvkYMw8A5X0hJrmb24gixZG4MPAhz6OKrH1Nii1QQ094TItTJwebCrT36JfgI Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Id: fea21868e80c43aa81d1a9d277da4e9d Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-TestMinimumBasicScenario-1524611858 Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Role: member,reader Jul 04 08:15:34.282548 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Roles: member,reader Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea21868e80c43aa81d1a9d277da4e9d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/volume/v3/fea21868e80c43aa81d1a9d277da4e9d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43/compute/v2/fea21868e80c43aa81d1a9d277da4e9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.43:8080/v1/AUTH_fea21868e80c43aa81d1a9d277da4e9d", "adminURL": "http://10.222.0.43:8080"}]}] Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-TestMinimumBasicScenario-1524611858 Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Id: fea21868e80c43aa81d1a9d277da4e9d Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1524611858 Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User: tempest-TestMinimumBasicScenario-1524611858-project Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Id: c11b4c72af804f68ad2bc19e91f11129 Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-TestMinimumBasicScenario-1524611858-project Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: method: > Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: exception: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b could not be found. Jul 04 08:15:34.284357 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: action_args: {'id': '7bd2b4ce-89f3-40e8-9840-487fc646456b'} Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b could not be found. Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 04 08:15:34.285304 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b could not be found. Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b could not be found. Jul 04 08:15:34.286826 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 04 08:15:34.288091 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Returning 404 to user: Instance 7bd2b4ce-89f3-40e8-9840-487fc646456b could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 04 08:15:34.288091 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-be436d5f-2851-4052-b015-7c9038d61d19 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b" status: 404 len: 111 microversion: 2.1 time: 0.036989 Jul 04 08:15:34.288091 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 639/1205] 10.222.0.43 () {58 vars in 1235 bytes} [Mon Jul 4 08:15:34 2022] GET /compute/v2.1/servers/7bd2b4ce-89f3-40e8-9840-487fc646456b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 04 08:15:34.293955 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: DEBUG nova.api.openstack.wsgi [None req-cb35f319-d053-410a-b4d6-e7e53179f2b7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] Calling method '.version_select at 0x7f05e579a4c0>' {{(pid=117870) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 04 08:15:34.314566 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO nova.api.openstack.requestlog [None req-cb35f319-d053-410a-b4d6-e7e53179f2b7 tempest-TestMinimumBasicScenario-1524611858 tempest-TestMinimumBasicScenario-1524611858-project] 10.222.0.43 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2114917443" status: 202 len: 0 microversion: 2.1 time: 0.025246 Jul 04 08:15:34.315342 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: [pid: 117870|app: 0|req: 567/1206] 10.222.0.43 () {58 vars in 1271 bytes} [Mon Jul 4 08:15:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2114917443 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 04 08:17:03.418480 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 08:17:03.419324 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Mon Jul 4 08:17:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 08:17:10.227380 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 08:17:10.228146 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Mon Jul 4 08:17:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 08:18:41.860112 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 08:18:41.860788 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Mon Jul 4 08:18:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 08:18:54.311333 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 08:18:54.312002 dv-cinder-797608-42-iscsi devstack@n-api.service[117870]: Mon Jul 4 08:18:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 08:20:23.431603 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 08:20:23.431603 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Mon Jul 4 08:20:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 04 08:20:30.237901 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 04 08:20:30.238840 dv-cinder-797608-42-iscsi devstack@n-api.service[117871]: Mon Jul 4 08:20:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!